-- Logs begin at Wed 2022-08-24 16:33:09 UTC, end at Wed 2022-08-24 17:49:40 UTC. -- Aug 24 17:17:13.448192 dv-cinder-851640-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 17:17:13.456996 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 17:17:13 2022] *** Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: nodename: dv-cinder-851640-4-iscsi Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: machine: x86_64 Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: clock source: unix Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: pcre jit disabled Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: detected number of CPU cores: 4 Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: current working directory: / Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: detected binary path: /usr/bin/uwsgi-core Aug 24 17:17:13.459706 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: your processes number limit is 47680 Aug 24 17:17:13.460441 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: your memory page size is 4096 bytes Aug 24 17:17:13.460441 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: detected max file descriptor number: 2048 Aug 24 17:17:13.460441 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: lock engine: pthread robust mutexes Aug 24 17:17:13.460441 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: thunder lock: enabled Aug 24 17:17:13.460441 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 17:17:13.460441 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 17:17:13.498061 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: Python main interpreter initialized at 0x55819892e9c0 Aug 24 17:17:13.498061 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: python threads support enabled Aug 24 17:17:13.498061 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: your server socket listen backlog is limited to 100 connections Aug 24 17:17:13.498061 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: your mercy for graceful operations on workers is 90 seconds Aug 24 17:17:13.498425 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 17:17:13.498503 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: *** Operational MODE: preforking *** Aug 24 17:17:13.498715 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: *** uWSGI is running in multiple interpreter mode *** Aug 24 17:17:13.498715 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: spawned uWSGI master process (pid: 105997) Aug 24 17:17:13.498927 dv-cinder-851640-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 17:17:13.499459 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: spawned uWSGI worker 1 (pid: 105998, cores: 1) Aug 24 17:17:13.499794 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: spawned uWSGI worker 2 (pid: 105999, cores: 1) Aug 24 17:17:13.499961 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 17:17:14.157230 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:17:14.163472 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:17:15.241549 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:17:15.241549 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: from cryptography.utils import int_from_bytes Aug 24 17:17:15.242183 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:17:15.242183 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: from cryptography.utils import int_from_bytes Aug 24 17:17:15.243279 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:17:15.243279 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: from cryptography.utils import int_from_bytes Aug 24 17:17:15.243707 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:17:15.243707 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: from cryptography.utils import int_from_bytes Aug 24 17:17:17.739771 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:17:17.740468 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:17:17.740570 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:17:17.740906 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:17:17.741164 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:17:17.741418 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:17:17.741772 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.741868 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:17:17.741950 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.742165 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.742260 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:17:17.742482 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.742580 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:17:17.742766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:17:17.742862 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.743135 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.743223 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.743455 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.743556 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.743772 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.743860 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.744084 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.744176 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.744348 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.744442 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.744661 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.744776 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.744987 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-4-iscsi {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.745093 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.745302 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.745398 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.745608 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.745701 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.745919 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.746016 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.746241 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.746335 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.746544 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.746632 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-4-iscsi {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.746864 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.746994 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.747189 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.747275 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.747496 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.747739 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.747901 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.748100 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.748220 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.748420 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.748541 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.748724 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.748851 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.749101 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.749219 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.749414 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.749551 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.749721 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.749857 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.750040 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.750176 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.750348 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.750485 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.750669 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.750796 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.750999 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.751142 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.751334 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.751461 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-4-iscsi {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.751639 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.751767 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.751957 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.752095 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.752262 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.752391 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.752660 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-4-iscsi {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.752797 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.752998 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.753123 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.753265 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.753405 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.753574 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.753710 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.753905 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.754031 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.754212 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.754353 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.754541 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.754669 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.754862 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.755565 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.755844 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.755985 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.756152 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.756285 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.756467 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.756599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.756775 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.756916 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.757086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.757220 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.757404 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.757532 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.757705 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.757839 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.758009 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.758142 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.758265 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.758386 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.758555 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.758689 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.758876 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.759041 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.759219 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.759347 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.759735 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.759863 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.760014 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.760147 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.760272 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.760403 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.760585 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.760721 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.760906 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.761065 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.761191 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.761322 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.761452 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.761587 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.761718 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.761841 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.762015 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.762145 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.762319 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.762454 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.762624 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.762752 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.762941 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.763085 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.763248 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.763376 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.763550 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.763678 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.763853 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.763989 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.764153 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.764288 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.764454 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.764581 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.764771 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.764900 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.765081 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.765208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.765398 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.765532 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.765700 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.765904 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.766045 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.766176 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.766352 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.766491 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.766615 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.766736 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.766940 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.767081 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.767279 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.767417 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.767595 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.767723 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.767899 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.768038 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.768204 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.768345 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.768520 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.768653 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.768821 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.768950 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.769122 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.769251 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.769383 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.769505 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.769657 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.769792 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.769960 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.770089 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.770278 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.770416 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.770570 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.770703 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.770866 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.771036 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.771191 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.771320 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.771500 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.771625 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.771798 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.771933 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.772098 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.772231 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.772397 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.772537 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.772695 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.772823 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.772988 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.773113 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.773285 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.773425 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.773586 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.773714 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.773889 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.774022 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.774188 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.774328 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.774488 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.774622 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.774790 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.774936 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.775114 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.775255 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.775415 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.775543 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.775718 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.775861 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.776066 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.776198 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.776323 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.776446 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.776608 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.776735 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.776913 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.777049 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.777213 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.777342 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.777527 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.777655 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.777829 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.778031 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.778153 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.778275 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.778432 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.778567 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.778735 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.778871 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.779064 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.779205 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.779381 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.779517 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.779683 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.779812 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.779983 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.780110 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.780288 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.780413 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.780582 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.780715 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.780882 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.781006 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.781184 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.781311 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.781484 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.781611 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.781784 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.781918 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.782080 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.782213 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.782368 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.782575 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.782703 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.782831 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.782972 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.783096 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.783260 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.783388 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.783558 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.783693 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.783854 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.783988 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.784168 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.784295 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.784485 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.784610 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.784787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.784919 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.785090 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.785216 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.785391 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.785524 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.785708 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:17:17.785845 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.786112 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.786256 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.786382 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.786528 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.786695 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.786853 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.787034 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.787192 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.787355 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.787507 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.787684 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.787835 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.788001 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.788136 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.788312 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.788440 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.788624 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.788759 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.788946 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.789074 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.789254 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.789382 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.789564 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.789694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.789872 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.790020 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.790186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.790321 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.790501 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.790637 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.790830 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.790976 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.791172 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.791300 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.791488 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.791609 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.791804 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.791931 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.792111 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.792248 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.792425 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.792560 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.792751 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.792879 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.793069 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.793210 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.793380 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.793555 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.793693 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.793815 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.793995 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.794139 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.794306 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.794447 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.794615 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.794743 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.794961 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.795106 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.795282 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.795416 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.795591 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.795718 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.795901 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.796036 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.796222 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.796367 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.796535 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.796645 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.796846 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.796945 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.797153 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.797250 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.797459 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.797597 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.797769 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.797874 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.798076 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.798175 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.798384 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.798485 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.798691 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.798780 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.799035 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.799139 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.799349 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.799438 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.799656 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.799744 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.799964 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.800072 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.800268 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.800434 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.800574 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.800662 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.800880 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.800973 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.801184 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.801280 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.801490 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.801592 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.802295 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.802392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.802603 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.802701 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.802920 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.803011 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.803235 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.803323 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.803554 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.803654 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.803878 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.803977 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.804184 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.804281 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.804493 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.804581 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.804802 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.804898 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.805110 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.805197 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.805419 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.805514 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.805726 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.805812 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.806033 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.806139 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.806344 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.806449 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.806652 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.806747 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.806985 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.807078 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.807385 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.807486 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.807697 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.807786 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.808011 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.808112 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.808322 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.808474 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.808625 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.808721 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.808930 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.809036 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.809242 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.809329 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.809549 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.809637 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.809858 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.809974 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.810166 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.810257 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.810475 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.810570 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.810796 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.810896 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.811130 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.811228 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.811440 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.811530 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.811772 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.811875 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.812099 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.812187 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.812402 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.812491 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.812726 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.812814 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.813036 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.813178 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.813345 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.813433 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.813649 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.813744 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.813959 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.814046 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.814261 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.814349 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.814564 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.814651 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.814866 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.814985 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.815199 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.815300 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.815503 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.815599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.815804 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.815898 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.816107 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.816205 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.816411 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.816540 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.816714 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.816809 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.817020 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.817116 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.817337 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.817461 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.818259 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.818360 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.818567 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.818665 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.818873 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.818985 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.819239 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.819341 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.819547 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.819636 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.819888 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.819975 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.820221 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.820319 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.820538 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.820634 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.820854 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.820948 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.821162 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.821255 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.821475 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.821571 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.821781 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.821867 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.822091 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.822178 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.822402 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.822491 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.822712 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.822799 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.823054 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.823147 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.823365 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.823454 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.823685 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.823771 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.823992 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.824087 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.824306 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.824399 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.824611 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.824697 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.824929 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.825025 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.825234 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.825322 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.825547 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.825635 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.825884 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.825983 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.826205 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.826293 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.826518 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.826647 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.826829 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.826954 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.827166 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.827253 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.827479 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.827566 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.827787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.827883 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.828095 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.828190 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.828402 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.828497 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.828709 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.828809 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.829027 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.829114 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.829334 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.829421 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.829648 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.829737 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.829953 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.830038 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.830270 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.830365 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.830573 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.830662 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.830887 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.831011 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.831213 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.831315 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.831526 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.831614 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.831849 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.831936 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.832164 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.832268 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.832470 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.832566 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.832778 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.832867 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.833105 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.833202 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.833414 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.833502 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.833720 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.833806 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.834029 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.834126 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.834333 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.834429 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.834638 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.834726 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.834965 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.835070 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.835278 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.835368 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.835587 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.835675 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.835890 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.835977 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.836191 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.836285 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.836503 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.836590 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.836812 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.836913 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.837118 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.837206 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.837419 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.837515 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.837727 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.837827 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.838040 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.838126 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.838345 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.838433 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.838663 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.838758 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.839004 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.839106 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.839311 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.839413 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.839612 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.839699 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.839932 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.840021 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.840239 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.840340 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.840540 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.840635 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.840842 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.840933 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.841142 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.841244 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.841477 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.841563 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.841782 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.841875 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.842084 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.842185 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.842395 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.842489 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.842706 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.842801 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.843048 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.843142 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.843359 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.843459 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.843666 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.843755 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.843973 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.844063 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.844282 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.844369 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.844592 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.844689 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.844896 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.844991 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.845206 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.845295 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.845514 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.845609 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.845820 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.845908 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.846128 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.846214 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.846442 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.846539 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.846748 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.846878 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.847084 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.847184 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.847394 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.847647 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.847737 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.847979 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.848066 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.848294 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.848380 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.848611 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.849363 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.849461 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.849693 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.849782 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.850010 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.850110 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.850329 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.850416 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.850647 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.850734 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.850988 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.851098 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.851317 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.851412 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.851626 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.851714 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.851934 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.852030 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.852247 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.852347 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.852554 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.852650 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.852860 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.852954 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.853165 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.853261 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.853475 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.853571 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.853778 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.853865 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.854085 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.854176 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.854391 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.854480 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.854701 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.854796 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.855031 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.855124 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.855338 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.855433 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.855642 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.855731 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.855949 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.856039 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.856262 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.856350 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.856566 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.856665 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.856874 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.856962 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.857175 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.857268 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.857477 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.857577 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.857801 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.857895 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.858104 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.858206 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.858407 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.858504 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.858711 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.858808 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.859073 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.859167 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.859379 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.859480 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.859703 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.859790 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.860030 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.860119 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.860337 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.860432 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.860645 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.860732 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.860951 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.861038 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.861263 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.861359 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.861566 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.861652 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.861869 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.861955 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.862173 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.862261 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.862480 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.862567 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.862787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.862874 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.863116 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.863207 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.863418 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.863504 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.863724 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.863811 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.864026 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.864121 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.864389 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.864972 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.865196 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.865292 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.865501 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.865588 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.865805 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.865892 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.866115 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.866210 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.866424 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.866519 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.866728 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.866814 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.867057 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.867163 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.867360 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.867448 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.867671 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.867758 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.867975 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.868071 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.868280 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.868368 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.868585 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.868675 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.868895 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.868989 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.869197 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.869284 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.869502 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.869588 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.869804 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.869892 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.870113 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.870201 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.870420 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.870508 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.870726 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.870815 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.871073 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.871165 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.871386 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.871475 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.871691 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.871781 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.871994 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.872082 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.872301 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.872397 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.872604 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.872692 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.872905 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.872993 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.873213 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.873312 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.873519 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.873607 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.873824 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.873913 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.874125 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.874220 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.874433 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.874521 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.874766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.874854 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.875098 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.875201 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.875400 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.875496 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.875704 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.875800 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.876004 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.876092 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.876306 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.876394 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.876606 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.876703 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.876908 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.876998 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.877209 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.877295 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.877513 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.877600 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.877829 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.877917 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.878134 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.878229 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.878439 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.878534 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.878741 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.878830 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.879105 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.879196 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.879413 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.879512 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.879722 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.879809 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.880058 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.880148 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.880372 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.880468 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.880678 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.880766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.880987 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.881074 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.881292 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.881391 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.881601 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.881688 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.881904 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.881992 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.882209 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.882306 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.882514 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.882597 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.882825 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.882943 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.883158 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.883249 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.883457 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.883551 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.883778 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.883868 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.884087 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.884179 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.884392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.884733 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.884956 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.885082 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.885273 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.885363 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.885595 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.885691 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.885899 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.885987 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.886207 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.886297 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.886515 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.886603 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.886820 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.886928 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.887152 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.887241 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.887457 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.887545 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.887762 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.887863 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.888066 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.888161 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.888370 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.888458 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.888675 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.888771 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.888979 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.889066 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.889282 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.889370 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.889589 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.889687 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.889890 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.889977 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.890191 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.890284 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.890490 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.890586 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.890799 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.890885 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.891124 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.891214 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.891432 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.891550 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.891733 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.891858 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.892039 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.892166 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.892341 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.892468 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.892764 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.892853 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.893072 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.893167 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.893379 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.893474 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.893681 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.893780 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.893982 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.894078 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.894287 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.894400 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.894599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.894696 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.894931 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.895034 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.895234 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.895331 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.895642 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.895733 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.895947 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.896048 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.896253 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.896342 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.896559 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.896654 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.896866 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.896969 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.897169 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.897263 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.897471 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.897559 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.897794 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.897883 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.898095 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.898183 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.898395 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.898489 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.898698 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.898817 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.899040 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.899143 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.899343 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.899432 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.899662 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.899846 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.900076 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.900173 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.900386 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.900474 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.900690 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.900780 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.901107 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.901217 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.901417 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.901516 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.901728 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.901818 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.902051 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.902141 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.902359 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.902534 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.902682 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.902772 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.903008 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.903116 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.903324 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.903420 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.903632 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.903732 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.903935 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.904031 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.904259 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.904350 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.904566 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.904664 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.904879 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.904968 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.905183 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.905272 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.905505 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.905604 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.905828 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.905918 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.906139 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.906229 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.906459 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.906549 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.906836 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.906943 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.907169 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.907260 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.907477 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.907571 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.907790 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.907880 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.908096 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.908280 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.908402 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.908596 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.908727 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.908904 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.909033 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.909211 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.909343 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.909514 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.909653 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.909819 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.909964 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.910141 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.910259 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.910447 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.910562 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.910756 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.910884 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.911091 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.911730 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.911923 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.912056 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.912229 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.912372 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.912532 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.912695 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.912854 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.913015 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.913153 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.913306 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.913473 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.913632 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.913786 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.913940 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.914107 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.914243 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.914426 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.914545 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.914731 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.914847 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.915076 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.915210 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.915383 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.915515 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.915683 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.915834 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.915983 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.916161 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.916283 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.916491 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.916622 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.916885 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.916975 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.917228 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.917318 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.917554 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.917641 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.917873 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.917970 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.918186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.918281 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.918508 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.918603 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.918815 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.918948 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.919145 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.919235 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.919456 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.919544 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.919761 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.919861 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.920066 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.920156 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.920369 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.920457 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.920675 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.920770 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.920980 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.921078 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.921283 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.921371 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.921587 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.921676 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.921896 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.921985 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.922200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.922295 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.922505 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.922594 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.922809 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.922914 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.923142 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.923231 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.923450 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.923541 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.923754 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.923842 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.924066 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.924155 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.924374 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.924466 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.924680 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.924769 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.924984 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.925083 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.925311 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.925399 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.925618 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.925713 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.925930 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.926031 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.926239 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.926328 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.926550 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.926639 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.927448 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.927564 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.927769 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.927862 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.928085 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.928173 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.928396 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.928494 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.928709 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.928797 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.929020 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.929109 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.929332 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.929421 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.929643 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.929849 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.929945 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.930183 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.930279 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.930501 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.930590 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.930815 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.931082 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.931175 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.931412 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.931503 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.931726 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.931823 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.932039 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.932128 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.932352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.932479 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.932665 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.932754 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.932976 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.933073 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.933287 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.933377 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.933599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.933695 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.933908 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.934006 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.934218 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.934314 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.934544 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.934634 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.934865 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.934987 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.935213 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.935304 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.935535 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.935630 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.935851 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.935953 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.936166 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.936264 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.936483 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.936573 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.936797 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.936886 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.937114 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.937203 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.937436 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.937533 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.937747 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.937880 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.938056 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.938183 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.938369 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.938466 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.938680 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.938767 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.939020 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.939114 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.939334 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.939424 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.939648 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.939736 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.939962 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.940059 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.940272 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.940368 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.940582 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.940671 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.940896 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.940986 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.941208 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.941298 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.941521 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.941616 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.941838 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.941935 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.942158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.942354 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.942496 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.942782 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.942870 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.943139 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.943267 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.943466 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.943656 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.943794 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.943970 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.944113 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.944303 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.944432 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.944628 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.944760 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.944953 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.945052 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.945266 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.945355 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.945582 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.945677 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.945907 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.945996 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.946215 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.946304 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.946521 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.946609 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.946829 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.946967 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.947162 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.947252 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.947468 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.947556 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.947786 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.947913 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.948099 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.948314 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.948410 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.948660 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.948758 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.948977 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.949064 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.949304 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.949512 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.949631 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.949859 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.949948 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.950180 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.950267 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.950511 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.950612 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.950839 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.950959 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.951174 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.951262 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.951480 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.951613 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.951789 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.951876 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.952096 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.952184 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.952402 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.952503 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.952712 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.952800 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.953021 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.953108 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.953326 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.953415 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.953628 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.953716 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.953930 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.954025 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.954238 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.954328 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.954547 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.954644 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.954851 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.954957 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.955180 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.955271 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.955490 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.955579 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.955795 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.955882 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.956097 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.956185 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.956399 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.956512 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.956701 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.956797 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.957001 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.957089 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.957301 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.957396 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.957602 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.957699 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.957905 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.958041 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.958240 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.958337 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.958549 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.958655 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.958855 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.958979 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.959182 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.959286 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.959491 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.959592 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.959799 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.959888 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.960104 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.960202 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.960410 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.960500 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.960733 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.960822 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.961038 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.961126 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.961369 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.961458 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.961683 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.961770 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.961992 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.962079 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.962314 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.962405 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.962625 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.962851 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.962959 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.963219 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.963319 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.963590 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.963685 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.963956 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.964116 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.964295 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.964450 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.964610 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.964769 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.964925 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.965098 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.965237 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.965427 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.965565 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.965734 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.965881 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.966040 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.966195 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.966345 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.966508 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.966668 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.966820 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.967000 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.967157 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.967311 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.967478 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.967620 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.967792 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.967930 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.968105 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.968242 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.968416 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.968543 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.968728 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.968831 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.969037 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.969146 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.969346 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.969455 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.969657 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.969754 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.969966 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.970055 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.970284 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.970377 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.970626 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.970715 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.970951 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.971043 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.971268 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.971358 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.971608 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.971699 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.971925 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.972016 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.972240 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.972329 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.972554 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.972643 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.972866 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.972952 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.973173 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.973269 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.973482 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.973571 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.974313 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.974405 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.974624 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.974724 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.974955 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.975047 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.975287 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.975377 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.975601 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.975702 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.975904 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.975994 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.976297 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.976385 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.976611 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.976701 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.976927 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.977016 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.977246 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.977336 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.977554 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.977644 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.977876 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.977965 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.978187 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.978274 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.978495 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.978590 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.978817 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.978963 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.979153 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.979255 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.979483 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.979573 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.979818 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.979906 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.980144 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.980242 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.980468 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.980571 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.980774 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.980864 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.981078 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.981175 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.981382 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.981471 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.981688 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.981774 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.981994 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.982091 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.982300 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.982387 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.982600 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.982687 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.982914 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.983008 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.983226 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.983317 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.983528 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.983615 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.983827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.983918 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.984129 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.984225 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.984429 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.984517 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.984731 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.984826 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.985031 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.985154 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.985333 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.985430 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.985635 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.985722 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.985936 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.986032 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.986236 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.986333 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.986536 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.986623 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.986837 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.986944 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.987161 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.987266 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.987464 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.987554 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.987765 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.987861 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.988067 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.988167 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.988369 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.988465 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.988704 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.988794 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.989022 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.989111 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.989396 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.989987 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.990264 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.990366 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.990621 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.990728 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.990963 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.991058 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.991284 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.991372 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.991597 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.991688 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.991924 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.992052 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.992234 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.992323 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.992540 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.992629 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.992849 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.992936 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.993159 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.993256 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.993468 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.993555 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.993774 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.993861 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.994081 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.994177 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.994389 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.994486 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.994696 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.994785 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.995039 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.995144 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.995358 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.995454 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.995662 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.995749 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.995982 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.996070 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.996294 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.996382 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.996612 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.996700 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.996918 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.997007 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.997224 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.997312 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.997531 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.997626 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.997844 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.997933 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.998149 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.998243 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.998456 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.998554 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.998763 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.998936 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.999094 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.999182 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.999407 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.999509 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.999716 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:17.999805 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.000025 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.000114 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.000340 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.000438 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.000653 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.000743 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.000979 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.001066 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.001302 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.001399 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.001610 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.001699 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.001936 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.002032 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.002263 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.002356 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.002593 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.002688 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.002935 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.003028 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.003239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.003329 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.003548 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.003636 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.003795 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:17:18.003892 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.004181 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.004487 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:17:18.004730 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:17:18.157936 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO dbcounter [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Registered counter for database nova_api Aug 24 17:17:18.160374 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO dbcounter [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Registered counter for database nova_api Aug 24 17:17:18.179710 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_db.sqlalchemy.engines [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:17:18.182403 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_db.sqlalchemy.engines [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:17:18.186319 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writer thread running {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:17:18.188850 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writer thread running {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:17:18.241401 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.context [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dfaa778-4c3d-4303-9287-6e7cd5ae3954(cell1) {{(pid=105999) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:17:18.244426 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.context [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dfaa778-4c3d-4303-9287-6e7cd5ae3954(cell1) {{(pid=105998) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:17:18.245255 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:17:18.245708 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:17:18.247311 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:17:18.248042 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:17:18.248345 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_concurrency.lockutils [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:17:18.248497 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:17:18.248821 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_concurrency.lockutils [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:17:18.250413 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_concurrency.lockutils [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:17:18.250505 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:17:18.251159 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_concurrency.lockutils [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:17:18.251617 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_concurrency.lockutils [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:17:18.252592 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO dbcounter [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Registered counter for database nova_cell0 Aug 24 17:17:18.253601 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_concurrency.lockutils [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:17:18.255611 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO dbcounter [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Registered counter for database nova_cell0 Aug 24 17:17:18.257933 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO dbcounter [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Registered counter for database nova_cell1 Aug 24 17:17:18.261279 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO dbcounter [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Registered counter for database nova_cell1 Aug 24 17:17:18.266335 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_db.sqlalchemy.engines [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:17:18.267551 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_db.sqlalchemy.engines [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:17:18.271986 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_db.sqlalchemy.engines [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:17:18.272807 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_db.sqlalchemy.engines [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:17:18.274138 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writer thread running {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:17:18.278876 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writer thread running {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:17:18.279359 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writer thread running {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:17:18.420822 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writer thread running {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:17:18.422031 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO dbcounter [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Registered counter for database nova_cell0 Aug 24 17:17:18.429414 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_db.sqlalchemy.engines [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:17:18.430764 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO dbcounter [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Registered counter for database nova_cell0 Aug 24 17:17:18.433884 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writer thread running {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:17:18.439552 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG oslo_db.sqlalchemy.engines [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:17:18.443795 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writer thread running {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:17:18.860664 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: WARNING keystonemiddleware.auth_token [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:17:18.867912 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: WARNING keystonemiddleware.auth_token [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:17:18.955138 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: WARNING keystonemiddleware.auth_token [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:17:18.966430 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: WARNING keystonemiddleware.auth_token [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:17:19.211816 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: WARNING keystonemiddleware.auth_token [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:17:19.218053 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: WARNING keystonemiddleware.auth_token [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:17:19.223480 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55819892e9c0 pid: 105999 (default app) Aug 24 17:17:19.225777 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:17:19.227011 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001914 Aug 24 17:17:19.227437 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Aug 24 17:17:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:17:19.305313 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: WARNING keystonemiddleware.auth_token [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:17:19.315842 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: WARNING keystonemiddleware.auth_token [None req-3c58ce87-be03-4262-8832-e894f7da989c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:17:19.321705 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55819892e9c0 pid: 105998 (default app) Aug 24 17:18:39.639982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:18:39.641586 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Aug 24 17:18:39.642133 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:18:39.654590 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writing DB stats nova_api:SELECT=3 {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:39.656322 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writing DB stats nova_cell1:SELECT=3 {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:39.657518 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writing DB stats nova_cell0:SELECT=3 {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:39.659013 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:40.523281 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-2e6928c9-c2b3-4fd5-9419-faf047f5dab3 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:18:40.563844 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-2e6928c9-c2b3-4fd5-9419-faf047f5dab3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.914428 Aug 24 17:18:40.564605 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 24 17:18:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:18:42.955250 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:18:42.956111 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-5c1a7250-0d39-4a7f-9996-35bf77d62ea9 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 24 17:18:42.957059 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:18:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:18:43.492767 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-23014840-9c4e-4bd6-a5da-d901c4706e69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:43.519071 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:18:43.519071 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: warnings.warn(msg) Aug 24 17:18:43.667512 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-23014840-9c4e-4bd6-a5da-d901c4706e69 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.701760 Aug 24 17:18:43.668228 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:18:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:18:43.682644 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_api:SELECT=3 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:43.683640 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_cell0:SELECT=3 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:43.684808 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_cell1:SELECT=3 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:43.685974 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:43.911855 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-8e63e3f6-831a-43de-b8eb-2efde9ef6b72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:43.916855 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:18:43.916855 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: warnings.warn(msg) Aug 24 17:18:44.043028 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-8e63e3f6-831a-43de-b8eb-2efde9ef6b72 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.366007 Aug 24 17:18:44.043605 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 24 17:18:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:18:46.403388 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-23014840-9c4e-4bd6-a5da-d901c4706e69 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:18:46.405113 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-23014840-9c4e-4bd6-a5da-d901c4706e69 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002170 Aug 24 17:18:46.405683 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:18:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:18:47.068765 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-b9c28bfd-c7a6-410b-9e23-6d4bf2efb871 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:47.087637 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:18:47.087637 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: warnings.warn(msg) Aug 24 17:18:47.175460 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-b9c28bfd-c7a6-410b-9e23-6d4bf2efb871 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.763648 Aug 24 17:18:47.176281 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:18:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:18:47.188754 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-972a13d5-ee8d-496f-ab49-d66e6f25ab24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:47.192212 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:18:47.192212 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: warnings.warn(msg) Aug 24 17:18:47.289874 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-972a13d5-ee8d-496f-ab49-d66e6f25ab24 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104661 Aug 24 17:18:47.290382 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 24 17:18:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:18:49.647761 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-b9c28bfd-c7a6-410b-9e23-6d4bf2efb871 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:18:49.649468 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-b9c28bfd-c7a6-410b-9e23-6d4bf2efb871 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002235 Aug 24 17:18:49.649898 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:18:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:18:50.050711 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-b3907939-6b8f-40a0-9353-a4ec3e84b662 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "name": "ds1G"}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:50.127079 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-b3907939-6b8f-40a0-9353-a4ec3e84b662 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470991 Aug 24 17:18:50.127621 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:18:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:18:50.140118 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-e874d35a-15ea-4380-be0d-c0c11d17081a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:50.197353 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-e874d35a-15ea-4380-be0d-c0c11d17081a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061029 Aug 24 17:18:50.197946 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 24 17:18:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:18:52.602670 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-b3907939-6b8f-40a0-9353-a4ec3e84b662 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:18:52.603727 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-b3907939-6b8f-40a0-9353-a4ec3e84b662 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 24 17:18:52.604123 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:18:53.026653 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-ba6ec7a9-a67d-491d-bc12-9a620c3f54d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:53.093956 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-ba6ec7a9-a67d-491d-bc12-9a620c3f54d3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483688 Aug 24 17:18:53.095171 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:18:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:18:53.108035 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-6624fe41-d47c-4c07-b2ae-eedfea1658c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:53.212045 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-6624fe41-d47c-4c07-b2ae-eedfea1658c4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107869 Aug 24 17:18:53.212618 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 24 17:18:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:18:55.604219 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-ba6ec7a9-a67d-491d-bc12-9a620c3f54d3 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:18:55.605214 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-ba6ec7a9-a67d-491d-bc12-9a620c3f54d3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 17:18:55.605607 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:18:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:18:56.037281 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-c05d1fb5-28e6-4fb1-aeaf-2d72a10d4156 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "swap": 0, "ram": 4096, "id": "d4"}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:56.101701 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-c05d1fb5-28e6-4fb1-aeaf-2d72a10d4156 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489158 Aug 24 17:18:56.102267 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:18:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:18:56.114267 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-0811baa6-901c-4ba7-ba4b-e2de46db5725 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:18:56.197841 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-0811baa6-901c-4ba7-ba4b-e2de46db5725 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087142 Aug 24 17:18:56.198746 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Aug 24 17:18:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:18:58.844602 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-c05d1fb5-28e6-4fb1-aeaf-2d72a10d4156 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:18:58.845627 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-c05d1fb5-28e6-4fb1-aeaf-2d72a10d4156 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 24 17:18:58.846026 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:18:59.307219 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-7440ec76-9dfb-4f0b-a634-1434211750a9 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:18:59.343837 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-7440ec76-9dfb-4f0b-a634-1434211750a9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.490530 Aug 24 17:18:59.346928 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 24 17:18:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:19:01.861815 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-c05d1fb5-28e6-4fb1-aeaf-2d72a10d4156 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:01.863591 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-c05d1fb5-28e6-4fb1-aeaf-2d72a10d4156 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002565 Aug 24 17:19:01.864258 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:02.300306 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-d6592f0c-850b-40e5-bd25-80bf19474f08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "disk": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny"}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:02.376953 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-d6592f0c-850b-40e5-bd25-80bf19474f08 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.505822 Aug 24 17:19:02.377635 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:19:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:19:02.390741 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-012f388a-134a-4c48-b2b4-f3765664164c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:02.471771 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-012f388a-134a-4c48-b2b4-f3765664164c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084575 Aug 24 17:19:02.472313 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 24 17:19:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:19:04.810716 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-d6592f0c-850b-40e5-bd25-80bf19474f08 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:04.811781 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-d6592f0c-850b-40e5-bd25-80bf19474f08 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 24 17:19:04.812397 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:05.176055 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-49e3a67a-6516-400b-bea0-9d1ea822c4cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:05.258185 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-49e3a67a-6516-400b-bea0-9d1ea822c4cd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.439216 Aug 24 17:19:05.258815 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:19:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:19:05.271152 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-f2598039-c032-492d-aa92-d09c7287a827 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:05.358862 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-f2598039-c032-492d-aa92-d09c7287a827 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091308 Aug 24 17:19:05.359479 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 24 17:19:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:19:07.757793 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-49e3a67a-6516-400b-bea0-9d1ea822c4cd admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:07.759878 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-49e3a67a-6516-400b-bea0-9d1ea822c4cd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002065 Aug 24 17:19:07.759878 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:08.220961 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-213922db-f405-4f5c-a188-0ad233e37249 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "name": "m1.medium"}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:08.302548 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-213922db-f405-4f5c-a188-0ad233e37249 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.535659 Aug 24 17:19:08.303130 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:19:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:19:08.316162 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-338e3907-2bbd-41a1-9ef2-a4e8c1becdba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:08.395030 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-338e3907-2bbd-41a1-9ef2-a4e8c1becdba admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082764 Aug 24 17:19:08.395772 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 24 17:19:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:19:10.807846 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-213922db-f405-4f5c-a188-0ad233e37249 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:10.809483 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-213922db-f405-4f5c-a188-0ad233e37249 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002222 Aug 24 17:19:10.816250 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:11.262318 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-a1fbe415-db34-4fa6-985f-6540b903f6b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "swap": 0, "disk": 80, "rxtx_factor": 1.0}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:11.271294 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:11.336754 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-a1fbe415-db34-4fa6-985f-6540b903f6b3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.519152 Aug 24 17:19:11.338940 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:19:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:19:11.349445 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-bb9378ec-f13d-41b8-ab93-5836bd868638 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:11.411461 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-bb9378ec-f13d-41b8-ab93-5836bd868638 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065624 Aug 24 17:19:11.412419 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 24 17:19:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:19:13.867778 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-a1fbe415-db34-4fa6-985f-6540b903f6b3 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:13.870876 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-a1fbe415-db34-4fa6-985f-6540b903f6b3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004171 Aug 24 17:19:13.871602 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:14.328794 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-92afd342-41b3-4354-bb5d-3b29132520f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:14.405145 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-92afd342-41b3-4354-bb5d-3b29132520f0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.526951 Aug 24 17:19:14.405614 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Aug 24 17:19:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:19:14.419903 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-1435ab89-e600-4be7-a142-f9a8321df3bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:14.508567 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-1435ab89-e600-4be7-a142-f9a8321df3bf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093770 Aug 24 17:19:14.509481 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Aug 24 17:19:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:19:33.694015 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-92afd342-41b3-4354-bb5d-3b29132520f0 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:33.695520 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-92afd342-41b3-4354-bb5d-3b29132520f0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Aug 24 17:19:33.695923 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:34.083583 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-cb4c7de9-ac35-4036-a128-16ade48cd267 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:34.101373 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-cb4c7de9-ac35-4036-a128-16ade48cd267 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399610 Aug 24 17:19:34.101914 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 24 17:19:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:19:35.158045 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-92afd342-41b3-4354-bb5d-3b29132520f0 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:35.159108 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-92afd342-41b3-4354-bb5d-3b29132520f0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 17:19:35.159505 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:19:35.689106 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-92914bdd-1447-4c35-95bc-251d219889c2 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:35.695355 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.wsgi [None req-92914bdd-1447-4c35-95bc-251d219889c2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-92914bdd-1447-4c35-95bc-251d219889c2 admin admin] Request method failure captured: Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Accept: application/json Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Accept-Encoding: gzip, deflate Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Connection: keep-alive Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Content-Length: 0 Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Host: 10.222.0.18 Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Openstack-Api-Version: compute 2.90 Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Openstack-System-Scope: None Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: User-Agent: python-novaclient Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Auth-Token: gAAAAABjBl2nb2FMqg8UV_TZwHIprtsUv8HbOz_SJNUpBTEqzkg0QPedDToeRSSMVji2CfmScJ4AkZgoJ1n0ExhbE-v1_k2lFryomc2nSCb_z-Pc9pqqxZkGcTa5260lWZ-gf8tv8EnIJ5RTNBCAW59k7nPX761sEmelaCLD9IcFHAwJ2ONugpc Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Domain-Id: None Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Domain-Name: None Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Identity-Status: Confirmed Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Is-Admin-Project: True Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Domain-Id: default Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Domain-Name: Default Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Name: admin Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Role: admin,member,reader Aug 24 17:19:35.698686 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Roles: admin,member,reader Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_68a3eec6caa5424ea6bb39d5d6e46c2f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Tenant: admin Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Tenant-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Tenant-Name: admin Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User: admin Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Domain-Id: default Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Domain-Name: Default Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Id: 20b73f4d8b424258a870e87b04c9a532 Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Name: admin Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: method: > Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: exception: Flavor 42 could not be found. Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: action_args: {'id': '42'} Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:19:35.700498 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:35.701510 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.703086 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-92914bdd-1447-4c35-95bc-251d219889c2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:19:35.704390 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-92914bdd-1447-4c35-95bc-251d219889c2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.405850 Aug 24 17:19:35.704390 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 24 17:19:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:35.709796 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-8c8a868e-e7c2-4018-ae3c-b434962f02b8 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:35.713937 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:35.731992 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-8c8a868e-e7c2-4018-ae3c-b434962f02b8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025846 Aug 24 17:19:35.732536 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 24 17:19:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:19:35.742749 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-6a25aa77-ee66-4a1b-8711-d7277765be97 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:35.767033 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-6a25aa77-ee66-4a1b-8711-d7277765be97 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028286 Aug 24 17:19:35.767560 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 24 17:19:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:19:35.776907 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-eb90bbbc-83ea-4585-b414-a83d47107c76 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:35.782962 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.wsgi [None req-eb90bbbc-83ea-4585-b414-a83d47107c76 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-eb90bbbc-83ea-4585-b414-a83d47107c76 admin admin] Request method failure captured: Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Accept: application/json Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Accept-Encoding: gzip, deflate Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Connection: keep-alive Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Content-Length: 0 Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Host: 10.222.0.18 Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Openstack-Api-Version: compute 2.90 Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Openstack-System-Scope: None Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: User-Agent: python-novaclient Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Auth-Token: gAAAAABjBl2nb2FMqg8UV_TZwHIprtsUv8HbOz_SJNUpBTEqzkg0QPedDToeRSSMVji2CfmScJ4AkZgoJ1n0ExhbE-v1_k2lFryomc2nSCb_z-Pc9pqqxZkGcTa5260lWZ-gf8tv8EnIJ5RTNBCAW59k7nPX761sEmelaCLD9IcFHAwJ2ONugpc Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Domain-Id: None Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Domain-Name: None Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Identity-Status: Confirmed Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Is-Admin-Project: True Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Domain-Id: default Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Domain-Name: Default Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Name: admin Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Role: admin,member,reader Aug 24 17:19:35.788444 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Roles: admin,member,reader Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_68a3eec6caa5424ea6bb39d5d6e46c2f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Tenant: admin Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Tenant-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Tenant-Name: admin Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User: admin Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Domain-Id: default Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Domain-Name: Default Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Id: 20b73f4d8b424258a870e87b04c9a532 Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Name: admin Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: method: > Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: exception: Flavor 42 could not be found. Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: action_args: {'id': '42'} Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:19:35.789982 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:35.790766 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:35.791827 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-eb90bbbc-83ea-4585-b414-a83d47107c76 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:19:35.792900 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-eb90bbbc-83ea-4585-b414-a83d47107c76 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014331 Aug 24 17:19:35.792900 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 24 17:19:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:36.743784 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-6a25aa77-ee66-4a1b-8711-d7277765be97 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:36.744802 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-6a25aa77-ee66-4a1b-8711-d7277765be97 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 24 17:19:36.745194 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:37.267495 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-023a5b0f-e125-4195-ba06-9d59c5771502 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:37.273293 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.wsgi [None req-023a5b0f-e125-4195-ba06-9d59c5771502 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-023a5b0f-e125-4195-ba06-9d59c5771502 admin admin] Request method failure captured: Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Accept: application/json Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Accept-Encoding: gzip, deflate Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Connection: keep-alive Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Content-Length: 0 Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Host: 10.222.0.18 Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Openstack-Api-Version: compute 2.90 Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Openstack-System-Scope: None Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: User-Agent: python-novaclient Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Auth-Token: gAAAAABjBl2oWf4vpgjYOOTRuPkRkDRNn0hM2lL4bbSUNmZvRnWXtduWn30zwZdYbqBTqyca_s6JRh1nPvxfWJ_gV4n2YJ37-MzpTrZ9MH5sWclXjF8PMAhNk0_TplC9C16oq5Y6Tlz2VLfW2P47XBqzUobLAaxxIXCf5lPXILvuvy5l4gk8ov8 Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Domain-Id: None Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Domain-Name: None Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Identity-Status: Confirmed Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Is-Admin-Project: True Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Domain-Id: default Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Domain-Name: Default Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Name: admin Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Role: admin,member,reader Aug 24 17:19:37.274787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Roles: admin,member,reader Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_68a3eec6caa5424ea6bb39d5d6e46c2f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Tenant: admin Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Tenant-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Tenant-Name: admin Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User: admin Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Domain-Id: default Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Domain-Name: Default Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Id: 20b73f4d8b424258a870e87b04c9a532 Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Name: admin Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: method: > Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: exception: Flavor 84 could not be found. Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: action_args: {'id': '84'} Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:19:37.276200 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:37.277037 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.278352 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-023a5b0f-e125-4195-ba06-9d59c5771502 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:19:37.279796 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-023a5b0f-e125-4195-ba06-9d59c5771502 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393466 Aug 24 17:19:37.279796 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 24 17:19:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:37.285632 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-4568c5fa-0b0a-415e-9ddf-c41d8adc2bb4 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:37.300935 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-4568c5fa-0b0a-415e-9ddf-c41d8adc2bb4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018815 Aug 24 17:19:37.301454 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 24 17:19:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:19:37.310630 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-ace8fb52-0291-46d6-bfb8-880bc8ab9446 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:37.325719 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-ace8fb52-0291-46d6-bfb8-880bc8ab9446 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018517 Aug 24 17:19:37.326233 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 24 17:19:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:19:37.335715 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-b47b9f77-fc71-4d33-8733-56d36e295207 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:37.340904 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.wsgi [None req-b47b9f77-fc71-4d33-8733-56d36e295207 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-b47b9f77-fc71-4d33-8733-56d36e295207 admin admin] Request method failure captured: Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Accept: application/json Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Accept-Encoding: gzip, deflate Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Connection: keep-alive Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Content-Length: 0 Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Host: 10.222.0.18 Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Openstack-Api-Version: compute 2.90 Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Openstack-System-Scope: None Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: User-Agent: python-novaclient Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Auth-Token: gAAAAABjBl2oWf4vpgjYOOTRuPkRkDRNn0hM2lL4bbSUNmZvRnWXtduWn30zwZdYbqBTqyca_s6JRh1nPvxfWJ_gV4n2YJ37-MzpTrZ9MH5sWclXjF8PMAhNk0_TplC9C16oq5Y6Tlz2VLfW2P47XBqzUobLAaxxIXCf5lPXILvuvy5l4gk8ov8 Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Domain-Id: None Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Domain-Name: None Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Identity-Status: Confirmed Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Is-Admin-Project: True Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Domain-Id: default Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Domain-Name: Default Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Name: admin Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Role: admin,member,reader Aug 24 17:19:37.342392 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Roles: admin,member,reader Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_68a3eec6caa5424ea6bb39d5d6e46c2f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Tenant: admin Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Tenant-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Tenant-Name: admin Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User: admin Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Domain-Id: default Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Domain-Name: Default Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Id: 20b73f4d8b424258a870e87b04c9a532 Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Name: admin Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: method: > Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: exception: Flavor 84 could not be found. Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: action_args: {'id': '84'} Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:19:37.343981 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:37.344943 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:37.346239 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-b47b9f77-fc71-4d33-8733-56d36e295207 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:19:37.347538 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-b47b9f77-fc71-4d33-8733-56d36e295207 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012099 Aug 24 17:19:37.347538 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Aug 24 17:19:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 17:19:38.305531 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-ace8fb52-0291-46d6-bfb8-880bc8ab9446 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:38.306546 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-ace8fb52-0291-46d6-bfb8-880bc8ab9446 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 24 17:19:38.306972 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:19:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:38.835993 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-e18030aa-8ea0-4047-beca-b718945542c0 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:38.841675 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.wsgi [None req-e18030aa-8ea0-4047-beca-b718945542c0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-e18030aa-8ea0-4047-beca-b718945542c0 admin admin] Request method failure captured: Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Accept: application/json Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Accept-Encoding: gzip, deflate Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Connection: keep-alive Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Content-Length: 0 Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Host: 10.222.0.18 Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Openstack-Api-Version: compute 2.90 Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Openstack-System-Scope: None Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: User-Agent: python-novaclient Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Auth-Token: gAAAAABjBl2q4tqV34Ld4K5Afalmp1iIwAiDIaJPd-i_HQU2Ig5xnvCh7DM_SYQSn7yTRYuLzrfMWomW3IWq8iMPdduLVxW5wEBkkfM5LUk1SkzuRUgUECB6DLdR6y1LIXwv-qC8-hxw4RU4VTgeRlVfmz6BPbV68RHDZayThee5Zi5t46hlYko Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Domain-Id: None Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Domain-Name: None Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Identity-Status: Confirmed Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Is-Admin-Project: True Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Domain-Id: default Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Domain-Name: Default Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Project-Name: admin Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Role: admin,member,reader Aug 24 17:19:38.843208 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Roles: admin,member,reader Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_68a3eec6caa5424ea6bb39d5d6e46c2f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Tenant: admin Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Tenant-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-Tenant-Name: admin Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User: admin Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Domain-Id: default Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Domain-Name: Default Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Id: 20b73f4d8b424258a870e87b04c9a532 Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: X-User-Name: admin Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: method: > Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: exception: Flavor 451 could not be found. Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: action_args: {'id': '451'} Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:19:38.844725 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:38.845694 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.847004 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-e18030aa-8ea0-4047-beca-b718945542c0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:19:38.848261 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-e18030aa-8ea0-4047-beca-b718945542c0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397280 Aug 24 17:19:38.848261 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 24 17:19:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:38.854603 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-3bacc649-cddf-4677-9196-90817db4c5c8 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:38.870059 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-3bacc649-cddf-4677-9196-90817db4c5c8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019493 Aug 24 17:19:38.870582 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 24 17:19:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:19:38.879905 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:38.894869 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018436 Aug 24 17:19:38.895452 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Aug 24 17:19:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:19:38.909897 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-f185a2eb-a7af-4781-9156-eb6547054851 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:38.919109 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.wsgi [None req-f185a2eb-a7af-4781-9156-eb6547054851 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-f185a2eb-a7af-4781-9156-eb6547054851 admin admin] Request method failure captured: Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Accept: application/json Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Accept-Encoding: gzip, deflate Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Connection: keep-alive Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Content-Length: 0 Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Host: 10.222.0.18 Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Openstack-Api-Version: compute 2.90 Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Openstack-System-Scope: None Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: User-Agent: python-novaclient Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Auth-Token: gAAAAABjBl2q4tqV34Ld4K5Afalmp1iIwAiDIaJPd-i_HQU2Ig5xnvCh7DM_SYQSn7yTRYuLzrfMWomW3IWq8iMPdduLVxW5wEBkkfM5LUk1SkzuRUgUECB6DLdR6y1LIXwv-qC8-hxw4RU4VTgeRlVfmz6BPbV68RHDZayThee5Zi5t46hlYko Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Domain-Id: None Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Domain-Name: None Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Identity-Status: Confirmed Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Is-Admin-Project: True Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Domain-Id: default Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Domain-Name: Default Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Project-Name: admin Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Role: admin,member,reader Aug 24 17:19:38.920599 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Roles: admin,member,reader Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_68a3eec6caa5424ea6bb39d5d6e46c2f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/68a3eec6caa5424ea6bb39d5d6e46c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Tenant: admin Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Tenant-Id: 68a3eec6caa5424ea6bb39d5d6e46c2f Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-Tenant-Name: admin Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User: admin Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Domain-Id: default Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Domain-Name: Default Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Id: 20b73f4d8b424258a870e87b04c9a532 Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: X-User-Name: admin Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: method: > Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: exception: Flavor 451 could not be found. Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: action_args: {'id': '451'} Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:19:38.922186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:38.923158 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: ERROR nova.api.openstack.wsgi Aug 24 17:19:38.924462 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-f185a2eb-a7af-4781-9156-eb6547054851 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:19:38.925688 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-f185a2eb-a7af-4781-9156-eb6547054851 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.018189 Aug 24 17:19:38.925688 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 24 17:19:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 17:19:39.882602 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:39.883685 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Aug 24 17:19:39.884075 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:40.405946 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-6c017bc3-14a9-45df-9101-63f99b9681f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:40.480475 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-6c017bc3-14a9-45df-9101-63f99b9681f4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.455029 Aug 24 17:19:40.480954 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 24 17:19:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:19:41.468547 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:41.469545 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 24 17:19:41.469946 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:19:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:41.986802 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-db3f2e53-37b3-448d-b596-277949574675 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:42.049872 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-db3f2e53-37b3-448d-b596-277949574675 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.443175 Aug 24 17:19:42.050343 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 24 17:19:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:19:43.011681 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:43.012969 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001752 Aug 24 17:19:43.013363 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:19:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:43.534281 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-b1d0af28-63dc-4f46-a180-23a734d6ad36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:43.668637 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-b1d0af28-63dc-4f46-a180-23a734d6ad36 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.520334 Aug 24 17:19:43.669123 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 24 17:19:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:19:44.704753 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:44.705757 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 17:19:44.706152 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:19:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:45.232449 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-55720a1d-ba64-4897-a9f1-b3a2a8a5534a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:19:45.329643 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-55720a1d-ba64-4897-a9f1-b3a2a8a5534a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.483998 Aug 24 17:19:45.330186 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Aug 24 17:19:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:19:46.300690 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:46.301703 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 17:19:46.302102 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:19:46.828494 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-6af555e1-df8b-4784-ad6f-99b93d4fe478 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:19:46.848931 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-6af555e1-df8b-4784-ad6f-99b93d4fe478 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406876 Aug 24 17:19:46.849475 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Aug 24 17:19:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:20:39.925111 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:20:39.926166 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-39e8e476-4f1d-46d5-903f-0cfe1ddf9d8b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 17:20:39.926748 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Wed Aug 24 17:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:20:39.937032 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:40.312668 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-6db9ae8a-0094-48f4-b330-da35c67d8172 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:20:40.332987 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-6db9ae8a-0094-48f4-b330-da35c67d8172 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400323 Aug 24 17:20:40.333601 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Aug 24 17:20:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:20:40.354616 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG dbcounter [-] [105998] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:40.358289 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-91a2d92d-b87e-46bc-8b54-cd869aed0fb7 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:20:40.365692 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-91a2d92d-b87e-46bc-8b54-cd869aed0fb7 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012468 Aug 24 17:20:40.366277 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Aug 24 17:20:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:20:40.377552 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-4baf0158-c796-4a95-811e-a6655d14c187 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:20:40.385541 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-4baf0158-c796-4a95-811e-a6655d14c187 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011530 Aug 24 17:20:40.386055 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Aug 24 17:20:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:20:40.398113 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:20:40.405926 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011937 Aug 24 17:20:40.406439 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Aug 24 17:20:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:20:40.417491 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-bbce54b2-0143-4487-bb93-a5a11f39a307 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:20:40.424908 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-bbce54b2-0143-4487-bb93-a5a11f39a307 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010911 Aug 24 17:20:40.425405 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Aug 24 17:20:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:23:44.796464 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:23:44.797465 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 24 17:23:44.797812 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:23:44.942012 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_api:SELECT=6 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:45.159178 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-366f74cf-6ba5-40bc-9a54-1aa2d701ce03 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:23:45.161773 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:23:45.161773 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: warnings.warn(msg) Aug 24 17:23:45.163031 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-366f74cf-6ba5-40bc-9a54-1aa2d701ce03 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:23:45.163517 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-366f74cf-6ba5-40bc-9a54-1aa2d701ce03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:23:45.163944 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-366f74cf-6ba5-40bc-9a54-1aa2d701ce03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:23:45.164660 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-366f74cf-6ba5-40bc-9a54-1aa2d701ce03 admin admin] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:23:45.165117 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-366f74cf-6ba5-40bc-9a54-1aa2d701ce03 admin admin] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:23:45.165521 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-366f74cf-6ba5-40bc-9a54-1aa2d701ce03 admin admin] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:23:45.201946 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-366f74cf-6ba5-40bc-9a54-1aa2d701ce03 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.261240 Aug 24 17:23:45.202590 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 24 17:23:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:23:46.077718 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:23:46.078880 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 24 17:23:46.080315 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:23:46.298162 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-ee944ed9-03e6-4037-ac08-3a40f83f5a86 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:23:46.301950 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:23:46.301950 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: warnings.warn(msg) Aug 24 17:23:46.303980 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-ee944ed9-03e6-4037-ac08-3a40f83f5a86 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:23:46.304855 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-ee944ed9-03e6-4037-ac08-3a40f83f5a86 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:23:46.305523 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-ee944ed9-03e6-4037-ac08-3a40f83f5a86 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:23:46.306789 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-ee944ed9-03e6-4037-ac08-3a40f83f5a86 admin admin] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:23:46.307631 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-ee944ed9-03e6-4037-ac08-3a40f83f5a86 admin admin] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:23:46.308325 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-ee944ed9-03e6-4037-ac08-3a40f83f5a86 admin admin] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:23:46.335658 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-ee944ed9-03e6-4037-ac08-3a40f83f5a86 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.114170 Aug 24 17:23:46.336257 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 24 17:23:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:23:57.610334 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:23:57.611471 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 24 17:23:57.611867 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:23:57.755688 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_cell0:SELECT=4 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:57.756404 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_cell1:SELECT=4 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:57.757022 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG dbcounter [-] [105999] Writing DB stats nova_api:SELECT=8 {{(pid=105999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:57.818166 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-12a10e7b-00d9-462b-9dc8-023a5c185f0e admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:23:57.820787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:23:57.820787 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: warnings.warn(msg) Aug 24 17:23:57.822642 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-12a10e7b-00d9-462b-9dc8-023a5c185f0e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:23:57.823222 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-12a10e7b-00d9-462b-9dc8-023a5c185f0e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:23:57.823652 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-12a10e7b-00d9-462b-9dc8-023a5c185f0e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:23:57.824367 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-12a10e7b-00d9-462b-9dc8-023a5c185f0e admin admin] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:23:57.825413 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-12a10e7b-00d9-462b-9dc8-023a5c185f0e admin admin] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:23:57.825825 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-12a10e7b-00d9-462b-9dc8-023a5c185f0e admin admin] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:23:57.854135 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-12a10e7b-00d9-462b-9dc8-023a5c185f0e admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.102800 Aug 24 17:23:57.854747 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 24 17:23:57 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:23:58.684979 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: DEBUG nova.api.openstack.wsgi [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] Calling method '>' {{(pid=105998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:23:58.686010 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: INFO nova.api.openstack.requestlog [None req-84ba8553-610f-406f-ade0-460e49ace9a4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 24 17:23:58.686399 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: [pid: 105998|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Aug 24 17:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:23:58.875713 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG nova.api.openstack.wsgi [None req-c43ab505-73f7-479b-83c2-38bbd933d962 admin admin] Calling method '>' {{(pid=105999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:23:58.878106 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:23:58.878106 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: warnings.warn(msg) Aug 24 17:23:58.879233 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-c43ab505-73f7-479b-83c2-38bbd933d962 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:23:58.879713 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-c43ab505-73f7-479b-83c2-38bbd933d962 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:23:58.880162 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-c43ab505-73f7-479b-83c2-38bbd933d962 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:23:58.881147 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-c43ab505-73f7-479b-83c2-38bbd933d962 admin admin] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:23:58.881630 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-c43ab505-73f7-479b-83c2-38bbd933d962 admin admin] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:23:58.882051 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: DEBUG oslo_concurrency.lockutils [None req-c43ab505-73f7-479b-83c2-38bbd933d962 admin admin] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:23:58.904828 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: INFO nova.api.openstack.requestlog [None req-c43ab505-73f7-479b-83c2-38bbd933d962 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081028 Aug 24 17:23:58.905379 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: [pid: 105999|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Aug 24 17:23:58 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:24:57.091278 dv-cinder-851640-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 17:24:57.092582 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: Wed Aug 24 17:24:57 2022 - graceful shutdown triggered... Aug 24 17:24:57.093070 dv-cinder-851640-4-iscsi devstack@n-api.service[105998]: Gracefully killing worker 1 (pid: 105998)... Aug 24 17:24:57.093506 dv-cinder-851640-4-iscsi devstack@n-api.service[105999]: Gracefully killing worker 2 (pid: 105999)... Aug 24 17:24:58.093394 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: worker 1 buried after 1 seconds Aug 24 17:24:58.093983 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: worker 2 buried after 1 seconds Aug 24 17:24:58.093983 dv-cinder-851640-4-iscsi devstack@n-api.service[105997]: goodbye to uWSGI. Aug 24 17:24:58.094926 dv-cinder-851640-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 17:24:58.095456 dv-cinder-851640-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 17:24:58.098339 dv-cinder-851640-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 17:24:58.111333 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 17:24:58.113913 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 17:24:58 2022] *** Aug 24 17:24:58.114062 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 17:24:58.114186 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 17:24:58.114301 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: nodename: dv-cinder-851640-4-iscsi Aug 24 17:24:58.114414 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: machine: x86_64 Aug 24 17:24:58.114525 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: clock source: unix Aug 24 17:24:58.114641 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: pcre jit disabled Aug 24 17:24:58.114760 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: detected number of CPU cores: 4 Aug 24 17:24:58.114872 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: current working directory: / Aug 24 17:24:58.115007 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: detected binary path: /usr/bin/uwsgi-core Aug 24 17:24:58.115146 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: your processes number limit is 47680 Aug 24 17:24:58.115261 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: your memory page size is 4096 bytes Aug 24 17:24:58.115374 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: detected max file descriptor number: 2048 Aug 24 17:24:58.115487 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: lock engine: pthread robust mutexes Aug 24 17:24:58.115778 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: thunder lock: enabled Aug 24 17:24:58.115961 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 17:24:58.116159 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 17:24:58.156164 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: Python main interpreter initialized at 0x5582188a49c0 Aug 24 17:24:58.156164 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: python threads support enabled Aug 24 17:24:58.156164 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: your server socket listen backlog is limited to 100 connections Aug 24 17:24:58.156164 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: your mercy for graceful operations on workers is 90 seconds Aug 24 17:24:58.156619 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 17:24:58.156619 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: *** Operational MODE: preforking *** Aug 24 17:24:58.156910 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: *** uWSGI is running in multiple interpreter mode *** Aug 24 17:24:58.156910 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: spawned uWSGI master process (pid: 121001) Aug 24 17:24:58.157118 dv-cinder-851640-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 17:24:58.158266 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: spawned uWSGI worker 1 (pid: 121010, cores: 1) Aug 24 17:24:58.158266 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: spawned uWSGI worker 2 (pid: 121011, cores: 1) Aug 24 17:24:58.158266 dv-cinder-851640-4-iscsi devstack@n-api.service[121001]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 17:24:58.830046 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:24:58.840457 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:24:59.982388 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:24:59.982388 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: from cryptography.utils import int_from_bytes Aug 24 17:24:59.983244 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:24:59.983244 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: from cryptography.utils import int_from_bytes Aug 24 17:25:00.025422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:25:00.025422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: from cryptography.utils import int_from_bytes Aug 24 17:25:00.025422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:25:00.025422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: from cryptography.utils import int_from_bytes Aug 24 17:25:02.442102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:25:02.442924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:25:02.442924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:25:02.443496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:25:02.443616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:25:02.443942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.444275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.444618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.444936 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.445420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.445739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.446068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.446392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.446729 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.447026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.447348 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.447678 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-4-iscsi {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.448150 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.448348 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.448621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.448961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.449264 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.449589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.450352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.450460 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.452476 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.452476 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.452476 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.452769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.453198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.453320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.453600 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.453895 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.454230 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.454553 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.454998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-4-iscsi {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.455327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.455637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.455947 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.456386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.456701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.457012 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.457329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.457735 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.457986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.458318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.458655 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.458989 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.459318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.459629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.459942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.460257 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.460581 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.460893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.461202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.461456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.461768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.462092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.462414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.462738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.463018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.463274 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.463770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.463931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.464240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.464563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.464859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.465057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:25:02.465494 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.465579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:25:02.465681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.465766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.465845 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:25:02.466065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.466175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:25:02.466406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.466544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:25:02.466729 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.466858 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.473027 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.473240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.473335 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.473430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.473506 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.473577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.473648 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.473725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.473811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.474131 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.474287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.474287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.474572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.474715 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.474896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.475085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.475241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.475392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.475536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.475693 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.475845 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.475996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.476158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-4-iscsi {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.476325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.476498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.476656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.476812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.476957 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.477127 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.477331 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.477511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.477682 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.477853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.478007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.478151 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.478313 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.478468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.478627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.478627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.478934 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.479104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.479250 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.479405 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.479556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.479700 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.479871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.480023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.480187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.480345 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.480345 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.480639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.480782 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.480932 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.481076 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.481236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.481421 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.481576 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.481727 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.481878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.482045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.483071 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.483254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.483408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-4-iscsi {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.483560 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.483720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.483871 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.484076 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.484234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.484379 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.484524 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.484681 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.484835 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.485202 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.485364 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.485510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.485670 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.485670 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.485973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.486125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.486283 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.486429 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.486580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.486730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.486874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.487041 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.487215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.487362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.487506 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.487655 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.487811 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.487964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.488309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.488469 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.488622 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.488859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.489015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.489168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.489168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.489168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.489168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.489168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.489168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.489168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.490425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.490608 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.490763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.490930 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.491091 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.491249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.491402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.491639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.491789 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.491932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.492084 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.492300 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.493164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.493320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.493473 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.493676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.493833 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.493833 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.494169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.494390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.494552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.494552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.494815 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.499537 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.499697 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.499697 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.499990 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.500257 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.500419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.500574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.500725 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.500890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.501070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.501228 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.501380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.501525 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.501669 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.501830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.501984 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.502130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.502281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.502426 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.502598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.503430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.503620 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.503775 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.503926 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.504078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.504285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.504443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.504597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.504750 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.504901 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.505078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.505231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.505505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.505677 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.505831 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.505976 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.506129 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.506281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.506435 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.506580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.506732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.506882 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.507070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.507215 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.507373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.507518 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.507673 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.507833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.507978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.508121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.508318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.508476 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.508621 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.508772 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.508917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.509061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.509251 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.509408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.509562 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.509723 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.509876 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.510033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.510221 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.510375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.510520 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.510672 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.510851 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.511073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.511220 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.511371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.511517 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.511661 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.511863 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.512029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.512182 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.512363 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.514410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.514572 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.514721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.514881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.515121 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.515545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.515788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.515946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.516099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.516266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.516457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.516607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.519596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.519775 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.519944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.520094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.520248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.520437 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.520597 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.520751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.520912 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.521079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.521224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.521494 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.521657 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.521810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.521967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.522316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.522547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.522710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.522920 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.523407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.523611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.523770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.523954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.524532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.524736 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.524899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.525052 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.525211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.525356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.525499 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.525686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.525958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.526108 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.526261 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.526412 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.526814 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.530273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.530391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.530472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.530545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.530617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.530706 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.530780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.530881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.531052 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.531163 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.531249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.531330 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.531410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.531486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.531564 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.531642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.531719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.531798 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.531872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.531968 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.531968 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.532111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.532192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.532273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.532351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.532430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.532510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.532582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.532651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.532730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.532801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.532870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:25:02.532940 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533017 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533103 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533354 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533740 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533823 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533904 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.533986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534516 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534850 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.534950 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535048 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535351 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535657 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535824 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.535906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536000 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536286 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536459 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536550 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536729 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536897 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.536991 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537081 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537171 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537666 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537849 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.537933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538542 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538630 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538803 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.538888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.540312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.540407 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.540487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.540559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.540636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.540708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.540777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.540874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.540948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541103 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541333 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541410 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541410 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541684 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541762 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541833 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.541980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542055 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542205 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542427 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542502 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542585 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542734 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.542984 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543142 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543282 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543518 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.543937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.544008 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.544085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.544161 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.544231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.544231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.544231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.544970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545199 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545279 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545429 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545429 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545650 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545729 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545800 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545800 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.545931 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546001 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546001 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546215 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546215 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546358 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546428 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546428 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546428 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546621 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546689 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546689 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.546920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547071 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547142 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547295 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547378 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547601 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547749 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547827 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.547976 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548113 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548782 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548863 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.548959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549135 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549226 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549317 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549400 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549564 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549744 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.549926 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550010 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550099 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550195 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550389 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550480 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550653 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550802 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.550893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551042 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551644 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.551739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.552111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.552209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.552209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.552209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.552209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.552511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.552609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.552609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.558405 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.558553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.558659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.558750 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.558835 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.558948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559054 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559142 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559478 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559915 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.559998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.560146 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.560738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.560834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.560918 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561338 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561591 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.561938 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562019 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562102 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.562539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.563436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.563436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.563689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.563817 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.563817 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.564079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.564214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.564919 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.565059 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.565188 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.565326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.565462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.565462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.565709 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.565843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.565843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.566096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.566223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.566439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.566569 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.566750 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.566965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.567123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.567406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.567556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.567721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.567938 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.568083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.568320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.568457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.568631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.568890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.569022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.569230 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.569382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.569545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.569827 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.569958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.570143 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.570318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.570458 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.570742 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.570872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.571094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.571274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.571407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.571665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.571803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.571969 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.572226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.572368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.572594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.572724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.572901 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.573167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.573305 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.573585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.573726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.573856 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.574091 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.574231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.574398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.574578 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.574711 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.575237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.575396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.575529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.575689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.575845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.575982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.576109 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.576283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.576481 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.576780 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.576928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.577056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.577194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.577468 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.577600 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.577771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.577978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.578114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.578354 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.578605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.578747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.579167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.579347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.579491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.579631 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.579768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.579909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.580037 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.580219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.580422 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.580567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.580858 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.580998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.581169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.581341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.581481 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.581787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.581924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.582100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.582289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.582421 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.582716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.582846 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.583046 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.583229 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.583363 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.583663 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.583804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.583974 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.584145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.584287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.584571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.584708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.584900 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.585356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.585585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.585725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.585888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.585888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.586139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.586264 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.586398 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.586531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.586743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.586879 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.587062 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.587331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.587508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.587677 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.587807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.587991 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.588218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.588358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.588603 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.588741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.588921 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.589299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.589596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.589744 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.589911 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.589911 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.590158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.590285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.590438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.590582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.590749 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.590971 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.591119 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.591423 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.591637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.591778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.592029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.592159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.592338 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.592559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.592698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.592947 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.593085 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.593252 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.593467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.593768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.593998 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.594130 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.594303 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.594435 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.594612 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.594803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.594984 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.595327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.595632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.595760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.595886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.596021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.596159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.596287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.596567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.596704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.596911 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.597046 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.597184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.597488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.597631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.597791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.597981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.598132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.598396 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.598536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.598723 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.598894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.599064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.599466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.599643 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.599775 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.599914 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.600042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.600242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.600382 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.600563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.600737 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.601419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.601514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.601598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.601598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.601812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.601984 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.602158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.602298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.602487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.602610 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.602813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.602954 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.603170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.603263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.603500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.603591 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.604804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.604923 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605282 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605702 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.605970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.606122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.606302 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.606457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.606607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.606751 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.606891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.607591 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.607745 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.607887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.608039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.608188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.608373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.608523 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.608700 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.608856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.609020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.609167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.609352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.609731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.609968 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.610134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.610278 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.610430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.610579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.610727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.610879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.611069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.611214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.611365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.611521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.611671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.611851 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.611999 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.612148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.612296 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.612449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.612598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.612747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.612896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.613045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.613186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.613334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.613484 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.613632 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.613632 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.613962 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.614246 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.614419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.614419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.614694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.614694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.615001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.615001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.615294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.615294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.615925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.616075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.616224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.616373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.616524 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.616676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.616825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.616975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.617116 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.617263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.617414 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.617554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.617695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.617834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.617975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.618115 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.618263 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.618411 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.618563 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.618711 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.618853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.619053 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.619204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.619345 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.619493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.619659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.620619 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.620790 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.620945 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.621089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.621241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.621389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.621531 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.621721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.621905 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.622049 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.622191 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.622377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.622534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.623289 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.623491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.623637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.623790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.623949 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.624104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.624377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.624531 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.624788 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.624881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.624967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.625138 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.625275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.625415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.625511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.625596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.625697 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.626113 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.626217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.626312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.626404 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.626489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.626622 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.626759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.626857 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.626980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627160 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627257 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627349 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627433 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627524 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627608 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627692 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.627952 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.628035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.628125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.628210 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.628309 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.628400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.628524 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.628663 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.628843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.628945 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.629161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.629259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.629479 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.629578 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.629796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.629896 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.630102 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.630202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.630409 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.630523 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.630841 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.630973 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.631070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.631157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.631348 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.631451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.631655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.631927 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.632029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.632260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.632352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.632575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.632669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.632889 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.632984 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.633205 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.633346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.633524 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.633667 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.633840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.633972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.634153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.634293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.634507 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.634608 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.634768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.634867 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.635105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.635213 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.635415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.635529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.635726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.635824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.636091 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.636253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.636350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.636442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.636641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.636742 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.636950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.637054 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.637276 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.637377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.637591 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.637683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.637906 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.638005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.638255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.638396 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.638580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.638679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.638895 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.639058 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.639227 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.639325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.639539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.639631 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.639853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.639953 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.640164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.640577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.640750 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.640925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.641073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.641259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.641409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.641546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.641682 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.641836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.641975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.642117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.642285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.642431 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.642609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.642769 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.642993 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.643131 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.643272 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.643411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.643588 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.643733 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.643904 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.644042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.644219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.644361 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.644533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.644734 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.644887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.645048 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.645187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.645387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.645597 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.645741 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.645876 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.646014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.646172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.646395 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.646494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.646637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.646739 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.646989 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.647097 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.647298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.647395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.647602 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.647695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.647914 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.648006 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.648224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.648317 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.648528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.648669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.648852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.648947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.649161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.649280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.649466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.649598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.649785 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.649905 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.650215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.650521 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.650827 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.651201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.651351 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.651522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.651663 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.651804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.651945 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.652093 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.652241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.652391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.652532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.652671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.652811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.652958 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.653136 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.653298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.653592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.653938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.654256 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.654570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.654894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.655073 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.655241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.655373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.655554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.655648 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.655866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.656050 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.656182 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.656500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.656613 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.656808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.656910 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.657125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.657225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.657436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.657535 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.657768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.657874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.658078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.658196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.658390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.658489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.658698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.658800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.659065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.659402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.659725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.659930 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.660080 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.660298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.660458 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.660629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.660731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.660955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.661099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.661341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.661439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.661588 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.661680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.661906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.662007 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.662227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.662341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.662543 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.662663 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.662867 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.663020 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.663206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.663334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.663522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.663646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.663835 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.663955 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.664165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.664257 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.664480 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.664580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.664841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.664943 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.665171 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.665269 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.665478 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.665578 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.665795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.665895 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.666111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.666201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.666421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.666642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.666746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.666833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.667049 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.667153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.667377 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.667639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.667739 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.667977 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.668076 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.668300 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.668390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.668626 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.668771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.668953 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.669084 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.669265 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.669365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.670114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.670216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.670427 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.670519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.670735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.670832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.671070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.671164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.671387 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.671530 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.671698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.671819 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.672018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.672162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.672335 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.672492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.672646 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.672816 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.672959 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.673150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.673275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.673466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.673589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.673803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.673908 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.674134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.674229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.674459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.674572 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.674778 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.674995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.675125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.675221 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.675448 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.675558 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.675754 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.675848 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.676069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.676172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.676381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.676490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.676698 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.676807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.677005 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.677161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.677299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.677518 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.677662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.677813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.677961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.678104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.678248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.678395 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.678541 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.678696 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.678841 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.678978 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.679140 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.679235 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.679454 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.679593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.679766 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.679886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.680077 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.680205 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.680385 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.680527 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.680732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.680854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.681041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.681167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.681374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.681481 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.681689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.681804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.682016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.682108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.682344 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.682436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.682665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.682773 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.683008 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.683106 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.683328 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.683429 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.683646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.683751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.683966 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.684066 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.684286 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.684423 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.684599 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.684733 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.684993 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.685683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.685828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.685973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.686110 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.686247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.686375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.686684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.686803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.687026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.687204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.687343 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.687497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.687648 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.687928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.688045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.688231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.688346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.688536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.688633 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.688846 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.688951 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.689150 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.689246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.689453 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.689556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.689758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.689863 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.690063 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.690159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.690369 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.690481 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.690675 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.690791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.691010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.691112 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.691319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.691417 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.691627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.691731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.691933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.692052 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.692237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.692333 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.692538 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.692636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.692873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.692969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.693210 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.693313 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.693528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.693632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.693857 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.693987 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.694393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.694601 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.694805 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703155 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703669 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703812 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.703961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704200 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704279 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704430 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704502 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704808 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.704964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705523 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705523 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.705936 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706009 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706171 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706243 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706314 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706453 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706614 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.706844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707031 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707376 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707450 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707608 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707900 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.707973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708044 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708114 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708323 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708401 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708621 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708700 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.708700 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709504 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.709962 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710032 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710103 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710244 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:25:02.710324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.710324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.711203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.711487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.712067 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.712513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.712835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.713177 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.713495 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.713812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.714125 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.714465 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.714801 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.715137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.715451 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.715762 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.716080 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.716696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.717012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.717322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.717795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.717947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.718265 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.718828 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.719468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.720040 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.720719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.721342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.721894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.722243 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.722572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.722949 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.723280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.723606 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.724169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.724556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.724887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.725230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.725570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.725886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.726200 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.726513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.726841 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.727186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.727505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.727821 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.728205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.728532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.728847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.729162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.729476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.729791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.730106 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.730418 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.730731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.731160 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.731390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.731862 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.732709 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.733031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.733355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.733675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.733999 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.734482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.734923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.735235 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.735549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.735872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.736204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.736522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.736832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.737264 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.737579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.737901 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.738224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.738594 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.738945 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.739314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.739635 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.739960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.740274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.740605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.741002 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.741462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.741959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.742434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.742764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.743103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.743459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.743785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.744145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.744602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.745059 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.745425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.745741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.746056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.746369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.746730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.747232 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.748325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.748576 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.748893 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.749205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.749550 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.749906 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.750371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.751181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.751181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.751512 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.751823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.752133 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.752475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.752814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.753169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.753500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.753819 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.754146 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.754460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.754785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.755135 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.755463 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.755779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.756115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.756429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.756745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.757062 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.757379 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.757691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.758004 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.758371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.758665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.759031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.759362 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.759685 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.760008 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.760324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.760638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.760971 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.761286 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.761600 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.761910 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.762221 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.762537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.762852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.763212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.763529 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.763850 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.764164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.764491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.764856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.765171 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.765753 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.766081 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.766430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.766748 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.767117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.767449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.769686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.769686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.769686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:25:02.769686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:25:02.770655 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO dbcounter [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Registered counter for database nova_api Aug 24 17:25:02.791160 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_db.sqlalchemy.engines [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:25:02.798350 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writer thread running {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:25:02.830568 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO dbcounter [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Registered counter for database nova_api Aug 24 17:25:02.850785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_db.sqlalchemy.engines [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:25:02.853359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.context [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dfaa778-4c3d-4303-9287-6e7cd5ae3954(cell1) {{(pid=121011) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:25:02.857933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:25:02.858060 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writer thread running {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:25:02.858408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:25:02.860110 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:25:02.860759 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:25:02.861204 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:25:02.863216 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:25:02.865254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO dbcounter [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Registered counter for database nova_cell0 Aug 24 17:25:02.869295 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO dbcounter [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Registered counter for database nova_cell1 Aug 24 17:25:02.877264 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_db.sqlalchemy.engines [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:25:02.880674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_db.sqlalchemy.engines [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:25:02.886821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writer thread running {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:25:02.888124 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writer thread running {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:25:02.923265 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.context [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dfaa778-4c3d-4303-9287-6e7cd5ae3954(cell1) {{(pid=121010) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:25:02.927393 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:25:02.927873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:25:02.929429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:25:02.930169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:25:02.930620 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:25:02.932608 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:25:02.934607 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO dbcounter [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Registered counter for database nova_cell0 Aug 24 17:25:02.939232 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO dbcounter [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Registered counter for database nova_cell1 Aug 24 17:25:02.946473 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_db.sqlalchemy.engines [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:25:02.948261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_db.sqlalchemy.engines [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:25:02.954215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writer thread running {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:25:02.956274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writer thread running {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:25:03.035013 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO dbcounter [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Registered counter for database nova_cell0 Aug 24 17:25:03.041768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_db.sqlalchemy.engines [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:25:03.047648 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writer thread running {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:25:03.108334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO dbcounter [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Registered counter for database nova_cell0 Aug 24 17:25:03.115443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_db.sqlalchemy.engines [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:25:03.120832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writer thread running {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:25:03.364184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: WARNING keystonemiddleware.auth_token [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:25:03.371472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: WARNING keystonemiddleware.auth_token [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:25:03.451489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: WARNING keystonemiddleware.auth_token [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:25:03.459247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: WARNING keystonemiddleware.auth_token [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:25:03.720305 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: WARNING keystonemiddleware.auth_token [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:25:03.726422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: WARNING keystonemiddleware.auth_token [None req-252ae2b5-9537-44b8-a57b-3672bad67683 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:25:03.731828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5582188a49c0 pid: 121011 (default app) Aug 24 17:25:03.801647 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: WARNING keystonemiddleware.auth_token [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:25:03.807717 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: WARNING keystonemiddleware.auth_token [None req-656412b2-f881-40e4-98a5-9bfd1fbf2ba7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:25:03.813583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5582188a49c0 pid: 121010 (default app) Aug 24 17:25:40.345781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=3 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.347500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=3 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.348406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=3 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.349945 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=3 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:41.528857 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cd99b3fe-1475-4c6e-8e67-1fe6fa027bd4 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] Action: 'create', calling method: .version_select at 0x7f3f31e2d8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-62767858", "metadata": {"Type": "work"}}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:25:43.209456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cd99b3fe-1475-4c6e-8e67-1fe6fa027bd4 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.885489 Aug 24 17:25:43.210461 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 24 17:25:40 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2888 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 17:25:43.722249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-83de6a4d-692c-46fa-93fc-01316c1d2f14 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] Calling method '.version_select at 0x7f3f31ee1430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:25:43.775247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:43.776103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:43.776992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:43.777835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:45.300331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83de6a4d-692c-46fa-93fc-01316c1d2f14 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba" status: 200 len: 351 microversion: 2.1 time: 2.077012 Aug 24 17:25:45.301644 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:25:43 2022] GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba => generated 351 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:25:46.316235 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a9846e89-d08f-4c4b-bfc4-5b95e559e250 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] Calling method '.version_select at 0x7f3f31c85790>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:25:46.547420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a9846e89-d08f-4c4b-bfc4-5b95e559e250 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba" status: 200 len: 352 microversion: 2.1 time: 0.235330 Aug 24 17:25:46.548321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:25:46 2022] GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba => generated 352 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:25:46.561785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6a41413e-36eb-427f-a4e6-c1348106a299 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] Calling method '.version_select at 0x7f3f31cbd790>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:25:46.655151 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6a41413e-36eb-427f-a4e6-c1348106a299 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba" status: 200 len: 352 microversion: 2.1 time: 0.097932 Aug 24 17:25:46.656213 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:25:46 2022] GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:25:46.675233 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-48e65d3b-e59b-416e-936f-4d3f7f179881 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] Calling method '.version_select at 0x7f3f31c85e50>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:25:47.034417 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-48e65d3b-e59b-416e-936f-4d3f7f179881 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba" status: 202 len: 0 microversion: 2.1 time: 0.357846 Aug 24 17:25:47.037983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:25:46 2022] DELETE /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:25:47.045287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c1a55347-2e1d-4cd4-89ba-32defa2ba9e2 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] Calling method '.version_select at 0x7f3f31cbd940>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:25:47.154518 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c1a55347-2e1d-4cd4-89ba-32defa2ba9e2 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba" status: 200 len: 351 microversion: 2.1 time: 0.114977 Aug 24 17:25:47.155156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:25:47 2022] GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:25:48.180210 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dbc39b8e-d2ce-4eb6-85cf-c1eea5599d48 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] Calling method '.version_select at 0x7f3f31c99550>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:25:48.235831 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-dbc39b8e-d2ce-4eb6-85cf-c1eea5599d48 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] HTTP exception thrown: Volume b3c99e85-d7d2-408c-9eaa-9cf8292c2cba could not be found. Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dbc39b8e-d2ce-4eb6-85cf-c1eea5599d48 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] Request method failure captured: Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba HTTP/1.1 Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8UHt-vG7JtwkJi1b6MYEsdN-I-dNFO7hVm4t3n3aMJ96B6CLsIw7FbBtSTw_YCouMOTU1GXn4L2hzQqcKm-jI9k1mPXjL3wr-KxvrTmASZM0zvGOvbHQgw_fbefjRHhBvsBcW70UBM-_N2za03NToqa3GIaSfeEtY556Wr3oZafnI Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 0ac70939c0ea4cf598ca556226001634 Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-VolumesGetTestJSON-565275111 Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:25:48.251342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0ac70939c0ea4cf598ca556226001634"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0ac70939c0ea4cf598ca556226001634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0ac70939c0ea4cf598ca556226001634", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0ac70939c0ea4cf598ca556226001634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-VolumesGetTestJSON-565275111 Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 0ac70939c0ea4cf598ca556226001634 Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-VolumesGetTestJSON-565275111 Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-VolumesGetTestJSON-565275111-project Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 2996e61856294680b80dd1de0ed827fe Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-VolumesGetTestJSON-565275111-project Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Volume b3c99e85-d7d2-408c-9eaa-9cf8292c2cba could not be found. Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': 'b3c99e85-d7d2-408c-9eaa-9cf8292c2cba'} Aug 24 17:25:48.252813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3c99e85-d7d2-408c-9eaa-9cf8292c2cba could not be found. (HTTP 404) (Request-ID: req-6c83346d-228c-4693-99e6-43f4ac4a1932) Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:25:48.253631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:25:48.254799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3c99e85-d7d2-408c-9eaa-9cf8292c2cba could not be found. Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:25:48.256095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3c99e85-d7d2-408c-9eaa-9cf8292c2cba could not be found. Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3c99e85-d7d2-408c-9eaa-9cf8292c2cba could not be found. Aug 24 17:25:48.257229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:25:48.261331 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dbc39b8e-d2ce-4eb6-85cf-c1eea5599d48 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] Returning 404 to user: Volume b3c99e85-d7d2-408c-9eaa-9cf8292c2cba could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:25:48.263832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-dbc39b8e-d2ce-4eb6-85cf-c1eea5599d48 tempest-VolumesGetTestJSON-565275111 tempest-VolumesGetTestJSON-565275111-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba" status: 404 len: 109 microversion: 2.1 time: 0.098200 Aug 24 17:25:48.266634 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:25:48 2022] GET /compute/v2.1/os-volumes/b3c99e85-d7d2-408c-9eaa-9cf8292c2cba => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:25:56.192475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0f4bae88-bf22-4e71-bb37-ca7a03acc288 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'create', calling method: .version_select at 0x7f3f31cbddc0>, body: {"keypair": {"name": "tempest-keypair-1262032300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBAA8DxQ+lIduR3PMTTKdZ/+W1cno8EZOXTGVgGAB///NbTKCnwEODppca4whDLUpV2XBSMMzpmrqG2HZfykzEe53yFsv981z9Eu1k1L/iCAlEhgolrPeN3wGVcFNamwQ=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:25:56.329353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-0f4bae88-bf22-4e71-bb37-ca7a03acc288 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Getting quotas for project 6c8612c530e1495f8d6f4927560a9012. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:25:56.348350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-0f4bae88-bf22-4e71-bb37-ca7a03acc288 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Getting quotas for user ef9e96b709b345c08a4ea10f14211668 and project 6c8612c530e1495f8d6f4927560a9012. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:25:56.567183 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0f4bae88-bf22-4e71-bb37-ca7a03acc288 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.823013 Aug 24 17:25:56.567800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 4/8] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:25:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:25:58.055544 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-842773336", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "networks": [{"uuid": "fb8f21c2-307c-4599-8a41-e1cd136fee82"}]}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:25:58.171842 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-57307225", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:25:58.424500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] validate_networks() for [('fb8f21c2-307c-4599-8a41-e1cd136fee82', None, None, None, None, None)] {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:25:58.450148 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] validate_networks() for [('9e086209-e46b-4d5d-918b-ba3ca2944349', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:26:00.338853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:26:00.339320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:26:00.339878 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:26:00.340232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:26:00.340646 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:26:00.394414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:00.394952 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:00.395387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:00.403913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:00.404529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:00.404979 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:00.537540 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Getting quotas for project 879c5673d2cf49f5973d1faa5f774c43. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:26:00.564539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Getting quotas for user bb2bc3ba87a549018d50fe3c9c6720d0 and project 879c5673d2cf49f5973d1faa5f774c43. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:26:00.606112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:26:00.619741 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:26:00.794778 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:26:00.795975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:26:00.796700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:26:00.797292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:26:00.797939 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:26:00.828831 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:00.833366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:00.834262 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:00.838208 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:00.839059 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:00.843591 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:00.901512 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Getting quotas for project cf9b8b1e5c0f4021ae5f40c11c962222. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:26:00.936080 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Getting quotas for user 0696e6f707274727b57a9a7493c47664 and project cf9b8b1e5c0f4021ae5f40c11c962222. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:26:00.968769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f5061976-df4c-47ea-956c-8515974e8aca tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.178315 Aug 24 17:26:00.981372 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:26:00.992960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:26:00.998419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 5/9] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:25:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:26:01.028931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e68cbcee-892a-4093-9fac-17d1ad782e1a tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:01.030561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e68cbcee-892a-4093-9fac-17d1ad782e1a tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:01.226147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33bf5ad0-fa5f-45ac-ab15-bfef09b62e13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.232210 Aug 24 17:26:01.227239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 5/10] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:25:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 3234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:26:01.248390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a89ab46-5183-4982-94e3-12d1dc9bb272 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:01.255572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a89ab46-5183-4982-94e3-12d1dc9bb272 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:01.337268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e68cbcee-892a-4093-9fac-17d1ad782e1a tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:01.388602 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e68cbcee-892a-4093-9fac-17d1ad782e1a tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1214 microversion: 2.1 time: 0.387128 Aug 24 17:26:01.390535 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 6/11] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:00 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1214 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:01.600044 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a89ab46-5183-4982-94e3-12d1dc9bb272 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:01.635758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a89ab46-5183-4982-94e3-12d1dc9bb272 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1220 microversion: 2.1 time: 0.399795 Aug 24 17:26:01.637529 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:01 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1220 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:02.285087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1146928172", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:02.414830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2fc91db3-a4a6-464f-8905-6b560b6d1f2b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:02.416880 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2fc91db3-a4a6-464f-8905-6b560b6d1f2b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:02.428075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] validate_networks() for [('9e086209-e46b-4d5d-918b-ba3ca2944349', None, None, None, None, None)] {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:26:02.793668 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2fc91db3-a4a6-464f-8905-6b560b6d1f2b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:02.803584 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2fc91db3-a4a6-464f-8905-6b560b6d1f2b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1214 microversion: 2.1 time: 0.395211 Aug 24 17:26:02.804799 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:02 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1214 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:03.828205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-02979441-6cc8-46e3-9698-0fb825ed2c4f tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:03.829773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-02979441-6cc8-46e3-9698-0fb825ed2c4f tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:04.364213 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-02979441-6cc8-46e3-9698-0fb825ed2c4f tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:04.372299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-02979441-6cc8-46e3-9698-0fb825ed2c4f tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1214 microversion: 2.1 time: 0.548908 Aug 24 17:26:04.392997 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 8/14] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:03 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1214 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:04.714624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:26:04.715174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:26:04.715595 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:26:04.716141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:26:04.716718 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:26:04.732381 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:04.735190 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:04.737114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:04.738844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44a97139-b637-45c8-acd0-cf1d6211c87a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'create', calling method: .version_select at 0x7f3f302f7e50>, body: {"keypair": {"name": "tempest-keypair-711717835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBM63NC+SLPakAbgdo5MbuAoQU/uthmHZsAEvY8Vgt8eUenfrQi79D9Z37RUyJZ5aEa/xBVialAgfIw16YCMXZ444OuNxyXWde2IEYoPj+7DtPtjlHvjMhokGHjWOLj9lA=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:04.739537 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:04.741035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:04.741666 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:04.757680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-44a97139-b637-45c8-acd0-cf1d6211c87a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Getting quotas for project 15cff6e1349f4bb1a2905e6e5231fc2d. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:26:04.793861 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-44a97139-b637-45c8-acd0-cf1d6211c87a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Getting quotas for user c379c845fccd43c08e8699976d506801 and project 15cff6e1349f4bb1a2905e6e5231fc2d. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:26:04.796044 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Getting quotas for project cf9b8b1e5c0f4021ae5f40c11c962222. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:26:04.811424 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Getting quotas for user 0696e6f707274727b57a9a7493c47664 and project cf9b8b1e5c0f4021ae5f40c11c962222. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:26:04.851532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:26:04.854088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:26:05.012213 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-44a97139-b637-45c8-acd0-cf1d6211c87a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.619694 Aug 24 17:26:05.016539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 9/15] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Aug 24 17:26:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 622 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 17:26:05.151198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4e31cc10-d0d1-4ce2-8911-ac14c9c84c17 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.864608 Aug 24 17:26:05.153855 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 7/16] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:26:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:26:05.170947 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-43af7588-b243-47eb-845d-566e348600e3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:05.172542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-43af7588-b243-47eb-845d-566e348600e3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:05.298179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-43af7588-b243-47eb-845d-566e348600e3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:05.306139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-43af7588-b243-47eb-845d-566e348600e3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1222 microversion: 2.1 time: 0.146145 Aug 24 17:26:05.306741 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 8/17] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:05 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:05.393973 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:05.394600 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:05.416231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:05.416231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:05.416231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:05.416585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:05.417112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:05.417556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:05.822271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-634aeb70-19f4-45ca-95c3-9c85e596e04c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: .version_select at 0x7f3f302fc160>, body: {"keypair": {"name": "tempest-keypair-165274637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+UEX1MQtF9gZeN4V7O6XptURctY3QTx5Lj6UvUVhwuDA7IEj4ERCREu9alZg27XlvP1dpx+q0JQcAbSxc0wp/dajRAXOqHVaKKz+yThHcELbrNapkeuhf7VxIyQDPnqg=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:05.860105 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:05.866479 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-634aeb70-19f4-45ca-95c3-9c85e596e04c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:26:05.879172 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-634aeb70-19f4-45ca-95c3-9c85e596e04c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for user 160ce86c89ea449da346d98d20ce2a9e and project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:26:05.901232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ecb64876-14ce-4c57-ad68-335b4cfa207d tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1210 microversion: 2.1 time: 0.510971 Aug 24 17:26:05.903075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 9/18] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:05 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1210 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:06.039971 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-634aeb70-19f4-45ca-95c3-9c85e596e04c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.025474 Aug 24 17:26:06.040596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 10/19] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:26:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:06.094477 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1288586582", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aab8f8e0-cb67-414f-9024-f218c766fbc7"}], "security_groups": [{"name": "tempest-securitygroup--1393276643"}], "key_name": "tempest-keypair-1262032300", "user_data": "}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:06.358801 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d44bc81f-14ae-42d4-90b6-9df265d03b75 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:06.359745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d44bc81f-14ae-42d4-90b6-9df265d03b75 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:06.531681 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d44bc81f-14ae-42d4-90b6-9df265d03b75 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:06.541715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d44bc81f-14ae-42d4-90b6-9df265d03b75 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1222 microversion: 2.1 time: 0.206829 Aug 24 17:26:06.544245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 11/20] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:06 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:06.586386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] validate_networks() for [('aab8f8e0-cb67-414f-9024-f218c766fbc7', None, None, None, None, None)] {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:26:06.924230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:06.925163 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:06.933966 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:06.936645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:06.941446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:06.941446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:06.942037 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:06.942543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:07.316705 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:07.356793 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-beb791d7-e366-424c-8752-0ee9de5a0949 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1274 microversion: 2.1 time: 0.432216 Aug 24 17:26:07.375731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 12/21] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:06 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1274 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:07.570455 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:07.574192 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:07.628829 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:07.629797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:07.630800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:07.635072 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:07.638746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:07.640519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:08.204034 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:08.222269 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04abd61c-2fd5-44f4-9ef9-8156c2be863d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1218 microversion: 2.1 time: 0.658457 Aug 24 17:26:08.222872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 13/22] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:07 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1218 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:08.399994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:08.407103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:08.416011 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:08.416558 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:08.417486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:08.419639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:08.423251 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:08.423786 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:08.646010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:26:08.646647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:26:08.647348 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:26:08.647828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:26:08.648448 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:26:08.689116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:08.691747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:08.702612 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:08.702612 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:08.702612 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:08.702612 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:08.749843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Getting quotas for project 6c8612c530e1495f8d6f4927560a9012. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:26:08.756160 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Getting quotas for user ef9e96b709b345c08a4ea10f14211668 and project 6c8612c530e1495f8d6f4927560a9012. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:26:08.772263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:26:08.790684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:26:09.038100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-336ffd5f-dbdb-4d8a-a1a4-9d5cefaf7f0d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.960463 Aug 24 17:26:09.042465 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 10/23] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:26:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:26:09.059845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-62a18358-22d2-4d4d-8fd7-acf39ed1473f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:09.065587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-62a18358-22d2-4d4d-8fd7-acf39ed1473f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:09.376118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:09.390166 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-373f119b-ff8c-4ea2-bff0-984f75c0aff1 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1272 microversion: 2.1 time: 0.996139 Aug 24 17:26:09.391259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 14/24] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:08 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1272 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:09.406704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:09.409363 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:09.447864 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:09.448774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:09.455406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-62a18358-22d2-4d4d-8fd7-acf39ed1473f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:09.460963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:09.471832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:09.471832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:09.471832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:09.475040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-62a18358-22d2-4d4d-8fd7-acf39ed1473f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1238 microversion: 2.1 time: 0.420713 Aug 24 17:26:09.476316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 11/25] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:09 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1238 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:09.635610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:09.656523 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1f14d8bc-42ff-4790-9b31-0ef99d849c77 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1292 microversion: 2.1 time: 0.263958 Aug 24 17:26:09.673109 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 15/26] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:09 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1292 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:10.414797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:10.415485 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:10.431406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:10.437392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:10.440345 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:10.444005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:10.451932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:10.452821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:10.501286 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e690ddd2-39f7-41a2-9626-3c0513e5a015 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:10.502659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e690ddd2-39f7-41a2-9626-3c0513e5a015 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:10.818636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e690ddd2-39f7-41a2-9626-3c0513e5a015 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:10.842603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e690ddd2-39f7-41a2-9626-3c0513e5a015 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1238 microversion: 2.1 time: 0.345115 Aug 24 17:26:10.864602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 16/27] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:10 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1238 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:10.885326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:10.899781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:10.921151 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:10.925796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:10.930881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:10.933491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:10.934284 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:10.938982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:10.939532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:11.498517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:11.519872 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d3d8a6c8-45e3-430d-99dc-e1fc819587f6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1272 microversion: 2.1 time: 1.108727 Aug 24 17:26:11.521214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 12/28] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:10 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1272 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:11.574467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:11.605019 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc9c4618-32b8-4831-8b69-85acf0e605f9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1280 microversion: 2.1 time: 0.738753 Aug 24 17:26:11.610559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 17/29] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:10 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1280 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:11.866188 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:11.867059 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:11.884006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:11.887148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:11.890688 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:11.906354 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:11.907842 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:11.909276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:12.145214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:12.145214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e13bba12-6bf6-446c-951c-c905482211fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1234 microversion: 2.1 time: 0.242187 Aug 24 17:26:12.145214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 13/30] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:11 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1234 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:12.567409 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:12.578147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:12.592204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:12.592729 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:12.593628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:12.594495 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:12.595375 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:12.596147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:12.638000 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:12.639062 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:12.651713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:12.652662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:12.653114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:12.653838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:12.654297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:12.660478 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:12.889013 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:12.906108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-93b3919f-46c4-4bf4-a4be-c80a2bd142d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1280 microversion: 2.1 time: 0.273573 Aug 24 17:26:12.913869 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 14/31] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:12 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:13.074391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:13.087154 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15df8819-cdf7-4ef4-a6cd-5409fa61b574 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.533674 Aug 24 17:26:13.087890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 18/32] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:12 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:13.132327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:13.133288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:13.154567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:13.156938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:13.157778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:13.160865 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:13.161622 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:13.162274 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:13.815297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:13.830621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e6809ca0-4654-42df-b010-2f0a9b41c28d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1290 microversion: 2.1 time: 0.695550 Aug 24 17:26:13.831997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 15/33] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:13 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1290 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:13.928922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:13.933409 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:13.943476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:13.945457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:13.946388 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:13.949347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:13.951301 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:13.951760 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:14.056980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:14.072987 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-961783dd-d433-4ee9-945c-c38244b01fcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1280 microversion: 2.1 time: 0.148647 Aug 24 17:26:14.091556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 19/34] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:13 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1280 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:14.113584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:14.114520 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:14.122015 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:14.122739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:14.123377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:14.124768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:14.126678 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:14.127707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:14.762716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:14.772044 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b9d09721-7418-4cd9-9354-b4a447962583 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.666055 Aug 24 17:26:14.781499 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 16/35] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:14 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:14.854182 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:14.855603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:14.868680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:14.871750 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:14.871750 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:14.871750 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:14.871750 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:14.872056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:15.098302 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:15.104387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:15.112226 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:15.115486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:15.116238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:15.118132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:15.119637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:15.122030 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:15.336466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:15.350218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9a521dd-9372-40ad-a754-093b7c510681 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1296 microversion: 2.1 time: 0.500264 Aug 24 17:26:15.355785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 20/36] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:14 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1296 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:15.801904 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:15.802748 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:15.814682 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:15.827332 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:15.828194 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:15.829128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:15.829793 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:15.830532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:16.403293 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:16.431768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3c1409cb-1bc8-420d-ba97-77891b31ed13 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 1.335557 Aug 24 17:26:16.450937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 17/37] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:15 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:16.462288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:16.464194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:16.476138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:16.478322 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:16.479643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:16.483727 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:16.483727 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:16.484336 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:16.704307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:16.728354 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b001d518-297a-4e68-bac0-2b2ddbeb1df9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.914831 Aug 24 17:26:16.729536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 21/38] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:15 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:16.739335 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-28212337", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f36e29c-a00d-4dea-8a63-ed5b84921e41"}], "security_groups": [{"name": "tempest-securitygroup--1566678370"}], "key_name": "tempest-keypair-711717835", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:17.049632 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:17.071746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0d3a9307-77b3-46d5-967c-e057aabb57b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1296 microversion: 2.1 time: 0.617111 Aug 24 17:26:17.073007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 18/39] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:16 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1296 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:17.461257 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:17.462187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:17.483497 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:17.486455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:17.486455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:17.486455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:17.486455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:17.486803 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:17.547334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] validate_networks() for [('0f36e29c-a00d-4dea-8a63-ed5b84921e41', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:26:18.575123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:18.616447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-aee19539-e611-4484-a5e4-4517f9f0634d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 1.142333 Aug 24 17:26:18.616447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 19/40] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:17 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:18.624629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:18.625289 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:18.633877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:18.634378 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:18.634827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:18.635579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:18.644929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:18.644929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:18.732813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=6 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:19.225030 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:19.241050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ee0ab7c5-1911-4c1b-b903-19bb75d08ae2 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.628561 Aug 24 17:26:19.242244 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:18 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:19.247287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:19.256239 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:19.274974 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:19.281151 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:19.281860 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:19.282751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:19.283389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:19.283967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:19.463494 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=24 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:19.493003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:19.508284 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5be0e41f-50f5-4cb5-a4e0-fc589cb7ee61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1296 microversion: 2.1 time: 0.264811 Aug 24 17:26:19.511997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 21/42] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:19 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1296 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:19.704429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:26:19.705261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:26:19.705591 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:26:19.706150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:26:19.706845 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:26:19.732998 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:19.733669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:19.738476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:19.738476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:19.738476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:19.738476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:19.780079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Getting quotas for project 15cff6e1349f4bb1a2905e6e5231fc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:26:19.793057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:19.795883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Getting quotas for user c379c845fccd43c08e8699976d506801 and project 15cff6e1349f4bb1a2905e6e5231fc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:26:19.838927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:26:19.846923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:26:19.934401 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-a19f3cec-202d-4ce1-a976-2d9c704a5c06 req-1ce32999-45ed-4448-8344-6ac687cdc7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "509a6e8e-d774-492b-9618-7de5caf2955f", "tag": "27819313-e232-4d79-a507-dd2f39913292"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:19.982020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a19f3cec-202d-4ce1-a976-2d9c704a5c06 req-1ce32999-45ed-4448-8344-6ac687cdc7eb service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:19.983161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a19f3cec-202d-4ce1-a976-2d9c704a5c06 req-1ce32999-45ed-4448-8344-6ac687cdc7eb service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:19.986606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a19f3cec-202d-4ce1-a976-2d9c704a5c06 req-1ce32999-45ed-4448-8344-6ac687cdc7eb service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:20.042886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-a19f3cec-202d-4ce1-a976-2d9c704a5c06 req-1ce32999-45ed-4448-8344-6ac687cdc7eb service nova] Creating event network-changed:27819313-e232-4d79-a507-dd2f39913292 for instance 509a6e8e-d774-492b-9618-7de5caf2955f on hv-cinder-85164 Aug 24 17:26:20.044100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a19f3cec-202d-4ce1-a976-2d9c704a5c06 req-1ce32999-45ed-4448-8344-6ac687cdc7eb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121011) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 17:26:20.044658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a19f3cec-202d-4ce1-a976-2d9c704a5c06 req-1ce32999-45ed-4448-8344-6ac687cdc7eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=121011) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 17:26:20.045897 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0974c0c6-45bd-49f4-b31d-40ecb349c61f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:20.046518 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0974c0c6-45bd-49f4-b31d-40ecb349c61f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:20.047184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0974c0c6-45bd-49f4-b31d-40ecb349c61f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:20.048099 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0974c0c6-45bd-49f4-b31d-40ecb349c61f None None] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:20.051208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0974c0c6-45bd-49f4-b31d-40ecb349c61f None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:20.051916 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0974c0c6-45bd-49f4-b31d-40ecb349c61f None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:20.073481 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.compute.rpcapi [None req-0974c0c6-45bd-49f4-b31d-40ecb349c61f None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 17:26:20.075008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0974c0c6-45bd-49f4-b31d-40ecb349c61f None None] Releasing lock "compute-rpcapi-router" {{(pid=121011) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 17:26:20.103414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0974c0c6-45bd-49f4-b31d-40ecb349c61f None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.590009 Aug 24 17:26:20.106098 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 22/43] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:20.124700 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:20.127055 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:20.143051 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-304f5fcd-98a8-4826-a045-f4dc8ed3ff60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.409843 Aug 24 17:26:20.144002 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 22/44] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Aug 24 17:26:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 3414 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 17:26:20.150593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:20.150593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:20.150593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:20.150593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:20.150893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:20.150893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:20.454039 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-252a9729-f0d6-400e-99d9-0dcd53cd1625 req-68c66aae-69ae-4b02-b957-ec0303b1c673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13b16c2-1e23-4a41-a74b-59285423fa33", "tag": "2e20a5cb-0c9d-45bd-991a-3253d8aa610d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:20.485053 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-252a9729-f0d6-400e-99d9-0dcd53cd1625 req-68c66aae-69ae-4b02-b957-ec0303b1c673 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:20.485549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-252a9729-f0d6-400e-99d9-0dcd53cd1625 req-68c66aae-69ae-4b02-b957-ec0303b1c673 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:20.486002 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-252a9729-f0d6-400e-99d9-0dcd53cd1625 req-68c66aae-69ae-4b02-b957-ec0303b1c673 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:20.525674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-252a9729-f0d6-400e-99d9-0dcd53cd1625 req-68c66aae-69ae-4b02-b957-ec0303b1c673 service nova] Creating event network-changed:2e20a5cb-0c9d-45bd-991a-3253d8aa610d for instance d13b16c2-1e23-4a41-a74b-59285423fa33 on hv-cinder-85164 Aug 24 17:26:20.531623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-252a9729-f0d6-400e-99d9-0dcd53cd1625 req-68c66aae-69ae-4b02-b957-ec0303b1c673 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 17:26:20.532189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-252a9729-f0d6-400e-99d9-0dcd53cd1625 req-68c66aae-69ae-4b02-b957-ec0303b1c673 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 17:26:20.534239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f765cd9-0c4f-46ef-a6d5-ef25ef5a8310 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:20.534722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f765cd9-0c4f-46ef-a6d5-ef25ef5a8310 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:20.537015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f765cd9-0c4f-46ef-a6d5-ef25ef5a8310 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:20.537764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f765cd9-0c4f-46ef-a6d5-ef25ef5a8310 None None] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:20.538227 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f765cd9-0c4f-46ef-a6d5-ef25ef5a8310 None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:20.538735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f765cd9-0c4f-46ef-a6d5-ef25ef5a8310 None None] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:20.562612 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.compute.rpcapi [None req-7f765cd9-0c4f-46ef-a6d5-ef25ef5a8310 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 17:26:20.563552 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f765cd9-0c4f-46ef-a6d5-ef25ef5a8310 None None] Releasing lock "compute-rpcapi-router" {{(pid=121010) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 17:26:20.602827 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7f765cd9-0c4f-46ef-a6d5-ef25ef5a8310 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.455998 Aug 24 17:26:20.606835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 23/45] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:20.618280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1876614298", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9785c9b4-9808-422c-887b-d51293243d04"}], "security_groups": [{"name": "tempest-securitygroup--1991861533"}], "key_name": "tempest-keypair-165274637", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:20.638766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:20.648883 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-71a71c5a-cbd8-4bff-8858-533d335758a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.539825 Aug 24 17:26:20.653507 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 23/46] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:20 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:20.667202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-00736792-8c27-459d-8e2a-bc03d885a172 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:20.668088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-00736792-8c27-459d-8e2a-bc03d885a172 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:20.917890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-00736792-8c27-459d-8e2a-bc03d885a172 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:20.951643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-00736792-8c27-459d-8e2a-bc03d885a172 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:20.958208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-00736792-8c27-459d-8e2a-bc03d885a172 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:20.960249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-00736792-8c27-459d-8e2a-bc03d885a172 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1279 microversion: 2.20 time: 0.305524 Aug 24 17:26:20.979284 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:20 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1279 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:20.985928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:20.989024 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:21.001763 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:21.002631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:21.003389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:21.004613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:21.005328 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:21.005970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:21.191123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] validate_networks() for [('9785c9b4-9808-422c-887b-d51293243d04', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:26:21.579207 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:21.590203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-19c760fb-26d7-4610-9ec5-21188a525567 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.606451 Aug 24 17:26:21.592743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:20 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:21.607440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:21.608256 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:21.626647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:21.633116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:21.633874 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:21.634824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:21.645344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:21.646051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:22.722888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:22.743978 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-feec7205-f022-4a87-9735-7269f783e4f6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 1.149536 Aug 24 17:26:22.748962 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 26/49] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:21 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:22.764006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:22.765525 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:22.789652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:22.791283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:22.792260 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:22.793680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:22.795411 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:22.796606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:22.863240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:26:22.871515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:26:22.871515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:26:22.871515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:26:22.871515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:26:22.914695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:22.916297 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:22.916736 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:22.919533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:22.919953 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:22.920391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:22.976227 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:26:23.000490 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for user 160ce86c89ea449da346d98d20ce2a9e and project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:26:23.067093 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:26:23.081490 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:26:23.235528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:23.239864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:23.250196 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-74b7cccc-81f5-4d7f-a2f3-743b639f7896 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.498537 Aug 24 17:26:23.258724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 27/50] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:22 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:23.264294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:23.265228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:23.273542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:23.275492 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:23.276218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:23.276922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:23.293436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:23.294151 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:23.294954 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:23.342550 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57a08af2-47de-4ced-aa23-63fd7efd1772 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.732563 Aug 24 17:26:23.351429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 24/51] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:26:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:26:23.366348 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:23.369127 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:23.378395 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:23.381589 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:23.384201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:23.384871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:23.389779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:23.390457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:23.392011 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:23.392137 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:23.393533 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:23.394934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f70faa13-af36-45ff-9347-ee80a403e7d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1331 microversion: 2.20 time: 0.134868 Aug 24 17:26:23.399304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 28/52] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:23 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:23.409496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-fe913e49-62a8-45c4-bede-02a37d335c3c req-382ef7e0-1fef-40bb-a5b0-ffcded7bdea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4358625-1c72-482d-8701-670df9093271", "tag": "0de6314b-7979-44ff-97cf-61fca7107b27"}, {"name": "network-changed", "server_uuid": "483b254a-2178-420a-8a82-111e13dfaa7e", "tag": "55059be5-28aa-4c2b-8f3b-8e394679665a"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:23.428757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-fe913e49-62a8-45c4-bede-02a37d335c3c req-382ef7e0-1fef-40bb-a5b0-ffcded7bdea8 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:23.428757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-fe913e49-62a8-45c4-bede-02a37d335c3c req-382ef7e0-1fef-40bb-a5b0-ffcded7bdea8 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:23.428757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-fe913e49-62a8-45c4-bede-02a37d335c3c req-382ef7e0-1fef-40bb-a5b0-ffcded7bdea8 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:23.449672 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-fe913e49-62a8-45c4-bede-02a37d335c3c req-382ef7e0-1fef-40bb-a5b0-ffcded7bdea8 service nova] Creating event network-changed:0de6314b-7979-44ff-97cf-61fca7107b27 for instance a4358625-1c72-482d-8701-670df9093271 on hv-cinder-85164 Aug 24 17:26:23.449825 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-fe913e49-62a8-45c4-bede-02a37d335c3c req-382ef7e0-1fef-40bb-a5b0-ffcded7bdea8 service nova] Creating event network-changed:55059be5-28aa-4c2b-8f3b-8e394679665a for instance 483b254a-2178-420a-8a82-111e13dfaa7e on hv-cinder-85164 Aug 24 17:26:23.458734 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-fe913e49-62a8-45c4-bede-02a37d335c3c req-382ef7e0-1fef-40bb-a5b0-ffcded7bdea8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057278 Aug 24 17:26:23.460162 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 29/53] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:23.467770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1a1c9303-c399-446d-8291-57281b569776 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:23.468986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1a1c9303-c399-446d-8291-57281b569776 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:23.577901 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1a1c9303-c399-446d-8291-57281b569776 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:23.611635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1a1c9303-c399-446d-8291-57281b569776 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1241 microversion: 2.1 time: 0.150085 Aug 24 17:26:23.612240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 30/54] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:23 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:23.671639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:23.684929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cbf74a32-c8f4-4d14-91be-095b8614f506 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.330842 Aug 24 17:26:23.686376 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 25/55] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:23 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:23.773570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:23.774728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:23.783502 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:23.784327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:23.784766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:23.785582 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:23.786044 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:23.786473 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:24.134987 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:24.145247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ff102fe1-d288-44aa-97c4-aeff1278b212 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.377454 Aug 24 17:26:24.146001 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 31/56] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:23 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:24.286262 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:24.288393 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:24.303364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:24.304202 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:24.305705 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:24.314216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:24.314812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:24.315279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:24.424563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:24.425223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:24.436351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:24.436913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:24.437556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:24.439509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:24.440165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:24.440748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:24.524651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:24.540718 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:24.543665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:24.548192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9020a7a1-6ec9-48e4-8dcf-edbdfa0f2314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1331 microversion: 2.20 time: 0.126414 Aug 24 17:26:24.548725 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 32/57] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:24 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:26:24.586532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:24.596298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa4344a8-0dd2-405e-8c1d-c8fb145089b4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.315909 Aug 24 17:26:24.616104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 26/58] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:24 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:24.643295 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b10624da-e6f5-4f68-8c88-5dfbd428ce60 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:24.644038 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b10624da-e6f5-4f68-8c88-5dfbd428ce60 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:24.704822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b10624da-e6f5-4f68-8c88-5dfbd428ce60 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:24.710573 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:24.719070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:24.719201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b10624da-e6f5-4f68-8c88-5dfbd428ce60 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1241 microversion: 2.1 time: 0.074528 Aug 24 17:26:24.719201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 33/59] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:24 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:24.719380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:24.719380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:24.719380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:24.719651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:24.720950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:24.721515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:24.925678 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:24.936191 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f670acae-0544-4be1-8ba9-33f406cb76a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.230133 Aug 24 17:26:24.947073 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 27/60] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:24 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:25.165696 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:25.167132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:25.176226 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.178277 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.181141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:25.182121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.183938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.184593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:25.370994 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:25.376441 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8f21d35b-79fd-45e4-9bfa-4feb4aac8ffd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.214703 Aug 24 17:26:25.377035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 34/61] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:25 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:25.571019 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:25.571782 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:25.580277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.580774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.581210 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:25.581908 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.582362 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.582783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:25.621025 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:25.621658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:25.628577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.629298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.629611 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:25.630332 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.630852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.631304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:25.664214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:25.676232 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:25.678015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:25.679276 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d18d0f05-15fd-4bdc-a183-0eca6476f442 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1339 microversion: 2.20 time: 0.112659 Aug 24 17:26:25.679853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 28/62] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:25 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1339 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:25.745198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:25.746428 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:25.753410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.753869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.754305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:25.755050 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.755506 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.761756 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:25.773239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=91 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:25.779379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:25.786877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e150eb3d-01e4-4398-9439-7a5041a41a79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.172388 Aug 24 17:26:25.787563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 35/63] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:25 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:25.871716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:25.880934 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a076d466-2018-4ec2-a00c-4a5c14102f97 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1245 microversion: 2.1 time: 0.140680 Aug 24 17:26:25.881540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 29/64] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:25 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1245 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:25.957270 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:25.957994 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:25.964096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.965144 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.965585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:25.966267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:25.966721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:25.967179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:26.102493 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:26.111008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b9b6f701-3aaa-4355-9626-6f339253cbc7 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.157628 Aug 24 17:26:26.111589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 36/65] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:25 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:26.399504 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:26.400114 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:26.411460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:26.412313 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:26.412755 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:26.413494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:26.414048 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:26.414366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:26.572533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:26.580802 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08f7763a-a082-4504-81a8-a89dad5bec07 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.184993 Aug 24 17:26:26.582380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 30/66] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:26 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:26.704050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:26.704650 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:26.711491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:26.711988 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:26.712429 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:26.713309 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:26.713881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:26.714896 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:26.805381 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:26.809305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:26.810096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:26.816764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:26.817250 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:26.819497 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:26.824145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:26.824262 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:26.824346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:26.824346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:26.824346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:26.824562 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3b5ffecc-9c8a-471a-a06c-322b256ef756 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1339 microversion: 2.20 time: 0.123389 Aug 24 17:26:26.825535 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 37/67] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:26 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1339 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:26.906751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:26.907413 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:26.913554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:26.914040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:26.914472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:26.915201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:26.917864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:26.917864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:27.007972 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:27.017400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:27.026714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83ccb7ca-1801-4c79-8d9c-bfc0c97e6467 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.221363 Aug 24 17:26:27.027746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 31/68] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:26 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:27.028819 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2cfe1081-d6d9-42f5-a8ee-ebc3211c9a49 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1245 microversion: 2.1 time: 0.129116 Aug 24 17:26:27.031033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 38/69] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:26 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:27.132004 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:27.132781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:27.139950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:27.140475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:27.141169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:27.141852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:27.142379 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:27.142805 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:27.439588 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:27.458155 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a96ecb7a-0126-4ff4-9a48-85703a7f6f81 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.329927 Aug 24 17:26:27.472695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 32/70] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:27 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:27.603031 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:27.604846 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:27.615382 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:27.616767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:27.617373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:27.618791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:27.619624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:27.624185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:27.835857 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:27.845076 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d5127bac-0eef-415f-8d60-6183c6c02b88 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.247095 Aug 24 17:26:27.849557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:27.850173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:27.859164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:27.859369 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 39/71] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:27 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:27.859666 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:27.860110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:27.863712 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:27.865346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:27.865809 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:27.934430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:27.942958 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:27.944528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:27.945636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f935dda2-8308-4fda-86c4-3890b4472cb5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1337 microversion: 2.20 time: 0.099949 Aug 24 17:26:27.946200 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 33/72] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:27 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:28.050140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:28.050618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:28.050753 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:28.051641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:28.057089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.060909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.060909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:28.061089 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.061172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.061242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.061322 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.061400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:28.061470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:28.061539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.061539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.062148 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:28.151029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:28.159117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3feece32-4c7d-45dc-b4fb-94d90effb81a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1237 microversion: 2.1 time: 0.112350 Aug 24 17:26:28.172730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 34/73] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:28 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1237 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:28.309999 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:28.320049 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a7c6de32-5e3a-47a7-b5d0-c9037a95b867 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.273890 Aug 24 17:26:28.328719 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 40/74] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:28 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:28.502582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:28.503225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:28.509959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.534708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.535226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:28.535978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.536620 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.537137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:28.774372 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:28.783146 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e967b761-47d1-43cf-8cf0-a2f3ea2a7272 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.284317 Aug 24 17:26:28.786831 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 35/75] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:28 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:28.865673 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:28.866298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:28.873446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.873943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.874379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:28.875105 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.877627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.877627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:28.970288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:28.970926 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:28.980306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.980809 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.981247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:28.981954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:28.982409 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:28.982838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:29.023467 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:29.045072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e7a230bf-8971-4ada-a3fe-c4db2e37e6a8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.182084 Aug 24 17:26:29.049554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 41/76] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:28 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:29.065027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:29.076241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:29.077768 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:29.078988 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c163165-51a6-41b7-877b-cfe889ba4a26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1337 microversion: 2.20 time: 0.113182 Aug 24 17:26:29.079722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 36/77] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:28 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:29.181027 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:29.181654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:29.188433 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:29.188929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:29.189550 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:29.190261 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:29.190893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:29.191337 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:29.257337 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:29.266132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1297449d-5f76-43de-81aa-b1a8cf224ae3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1237 microversion: 2.1 time: 0.088635 Aug 24 17:26:29.266678 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 42/78] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:29 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:29.344207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:29.344895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:29.351843 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:29.352328 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:29.352945 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:29.353937 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:29.354556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:29.355014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:29.505699 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:29.514293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-606011f2-cbd6-4447-9cb2-b3ed4d5bfce6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.174439 Aug 24 17:26:29.514884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 37/79] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:29 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:29.804536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:29.805236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:29.811998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:29.812493 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:29.813011 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:29.813760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:29.814227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:29.814654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:29.952442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:29.960253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-529cb64c-30fd-4900-928f-8dc337e7ac58 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.159544 Aug 24 17:26:29.960827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 43/80] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:29 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:30.071566 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:30.072344 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:30.083979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.084472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.084908 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:30.085599 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.086110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.086533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:30.104258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:30.104922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:30.106943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:30.111773 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.112262 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.112699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:30.113422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.113880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.114307 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:30.218887 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:30.218887 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:30.219121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:30.219121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-92406d6a-5e23-4df4-b23a-b28c4ee5ae2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1337 microversion: 2.20 time: 0.095293 Aug 24 17:26:30.219121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 44/81] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:30 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1337 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:26:30.260710 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:30.265587 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4c8efe5b-2427-4419-b319-5252fccadd13 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.199851 Aug 24 17:26:30.266445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 38/82] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:30 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:30.285526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:30.286715 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:30.293010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.293507 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.293946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:30.294647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.295134 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.295745 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:30.363057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:30.371618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4aeccf56-975d-4d48-8620-89a61de189b8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1237 microversion: 2.1 time: 0.089933 Aug 24 17:26:30.372189 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 45/83] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:30 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:30.536819 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:30.537382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:30.543901 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.544409 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.544957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:30.545672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.546131 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.546554 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:30.678944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:30.689258 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e383b80b-88ea-4e4c-bc3d-14dbbeaddfcc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.156639 Aug 24 17:26:30.690025 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 39/84] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:30 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:30.979821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:30.980436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:30.986989 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.987485 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.987941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:30.988692 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:30.989145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:30.989598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:31.124152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:31.132186 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-84e1ab47-f74a-40e5-82c6-3d5a5320ac0b tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.156390 Aug 24 17:26:31.132767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 46/85] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:30 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:31.236611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:31.237352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:31.243976 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:31.244551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:31.246084 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:31.246562 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:31.250231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:31.250870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:31.288366 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:31.289449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:31.300346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:31.300346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:31.300346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:31.300346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:31.300656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:31.300656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:31.304378 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:31.326485 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:31.336062 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:31.337759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:31.339196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bbbd572e-fb87-482e-8aef-c5e2c4e9012b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1337 microversion: 2.20 time: 0.108194 Aug 24 17:26:31.339873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 40/86] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:31 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1337 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:31.401230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:31.401877 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:31.421367 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:31.421925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:31.422371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:31.423107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:31.423565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:31.424326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:31.532799 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:31.546441 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:31.556508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cc93cb3e-b83a-4830-aa12-bea8f9806562 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.271924 Aug 24 17:26:31.563319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 47/87] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:31 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:31.567268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24b30c58-8378-4cef-8fb6-d3b62a5a94ff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1237 microversion: 2.1 time: 0.169471 Aug 24 17:26:31.568539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 41/88] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:31 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1237 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:31.711362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:31.712350 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:31.719563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:31.720045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:31.720698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:31.721407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:31.721855 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:31.722275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:31.869683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:31.880478 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d793cf98-9d72-4ca0-9a3e-4d133b0cf7c1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.173102 Aug 24 17:26:31.881561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 48/89] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:31 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:32.160551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:32.162330 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:32.169546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.170137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.170946 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:32.171870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.172566 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.173212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:32.329783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:32.337614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ecdb321-d2e6-47b0-85fa-3066f93a9121 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.187743 Aug 24 17:26:32.338256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 42/90] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:32 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:32.361793 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:32.362270 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:32.368759 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.369248 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.369688 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:32.370924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.371388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.371816 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:32.445826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:32.455316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:32.456827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:32.457947 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ea025f4c-dfba-49e4-b537-74f686368464 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1337 microversion: 2.20 time: 0.100118 Aug 24 17:26:32.458528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 49/91] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:32 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:26:32.584186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:32.584186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:32.593381 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:32.593381 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:32.598867 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.599398 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.599844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:32.600560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.601028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.601456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:32.616618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.616618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.616618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:32.616618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.616958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.617450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:32.704173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:32.712774 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2718ad28-436b-418b-b45f-e540d624312e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1237 microversion: 2.1 time: 0.124915 Aug 24 17:26:32.726185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 50/92] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:32 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1237 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:32.773104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:32.783256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0cfb0357-3cfe-4076-addf-ba3ae4fd58f5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.206555 Aug 24 17:26:32.784239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 43/93] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:32 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:32.902491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:32.903316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:32.909708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.910258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.915552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:32.915552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:32.915552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:32.915552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:33.358665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:33.360223 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:33.371619 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:33.372568 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=40 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:33.380794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:33.386519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:33.386519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:33.386519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:33.386519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:33.387049 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:33.488756 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:33.496853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3c6f9bb3-f980-4c47-9517-322e8cdaace6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.598960 Aug 24 17:26:33.510068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 51/94] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:32 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:33.520891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:33.523386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:33.532291 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:33.533023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:33.533783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:33.534992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:33.535873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:33.536759 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:33.588967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:33.601181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad447774-4edf-4b31-bd55-968fa122e4d5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.246994 Aug 24 17:26:33.601969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 44/95] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:33 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:33.640723 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:33.653536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:33.655268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:33.661827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c82b007c-3b9c-4e9b-87c1-957bfbc2813e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1337 microversion: 2.20 time: 0.144462 Aug 24 17:26:33.661827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 52/96] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:33 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1337 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:33.733629 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:33.742594 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:33.742594 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:33.742594 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:33.742594 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:33.743035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:33.743035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:33.743035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:33.815148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:33.815874 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:33.826478 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:33.826726 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:33.826726 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:33.826726 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:33.826726 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:33.827023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:33.827023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:33.830759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-02e6f727-1617-4461-9bb1-e59bc9cbd4b1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1293 microversion: 2.1 time: 0.100956 Aug 24 17:26:33.833449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 45/97] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:33 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:34.078390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:34.087211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-49cd26c3-ba8b-404a-9493-e5ec3f10132b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.276943 Aug 24 17:26:34.087803 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 53/98] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:33 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:34.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:34.524438 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:34.541281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:34.541281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:34.541281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:34.541281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:34.543178 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:34.548153 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:34.566532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:34.623787 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:34.624654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:34.631300 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:34.632781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:34.633974 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:34.634305 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:34.635403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:34.637089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:34.710199 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=6 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:34.822183 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:34.844870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:34.850048 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e1fd395-9eaf-4d83-82bc-0b36664cdee5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.331324 Aug 24 17:26:34.863203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 46/99] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:34 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:34.863203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:34.863505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:34.868783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c2bde94e-d723-4969-be51-ef96b884c546 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.250137 Aug 24 17:26:34.869376 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 54/100] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:34 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:34.878870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:34.880789 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:34.881577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:34.882189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:34.883173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:34.883937 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:34.884875 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:34.885496 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:34.906757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:34.907289 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:34.907739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:34.908472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:34.908932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:34.909357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:35.078868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:35.091492 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e17ea273-90e6-47d4-95d7-088ca9cf670c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1293 microversion: 2.1 time: 0.218242 Aug 24 17:26:35.106932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 55/101] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:34 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1293 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:35.136722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:35.146359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:35.147510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:35.148640 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c0eec8da-ff81-4d26-a901-985ecb837be8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.297022 Aug 24 17:26:35.149204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 47/102] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:34 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:35.155283 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:35.156094 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:35.162682 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:35.163633 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:35.164248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:35.165125 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:35.166342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:35.166976 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:35.197876 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-d609b6e9-7325-483a-bfc2-26db4ed91d7b req-2e96eb06-9a64-40f6-967d-2417da4e11b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13b16c2-1e23-4a41-a74b-59285423fa33", "name": "network-vif-plugged", "status": "completed", "tag": "2e20a5cb-0c9d-45bd-991a-3253d8aa610d"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:35.209201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-d609b6e9-7325-483a-bfc2-26db4ed91d7b req-2e96eb06-9a64-40f6-967d-2417da4e11b3 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:35.209720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-d609b6e9-7325-483a-bfc2-26db4ed91d7b req-2e96eb06-9a64-40f6-967d-2417da4e11b3 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:35.210148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-d609b6e9-7325-483a-bfc2-26db4ed91d7b req-2e96eb06-9a64-40f6-967d-2417da4e11b3 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:35.224140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-d609b6e9-7325-483a-bfc2-26db4ed91d7b req-2e96eb06-9a64-40f6-967d-2417da4e11b3 service nova] Creating event network-vif-plugged:2e20a5cb-0c9d-45bd-991a-3253d8aa610d for instance d13b16c2-1e23-4a41-a74b-59285423fa33 on hv-cinder-85164 Aug 24 17:26:35.229483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-d609b6e9-7325-483a-bfc2-26db4ed91d7b req-2e96eb06-9a64-40f6-967d-2417da4e11b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135174 Aug 24 17:26:35.230330 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 56/103] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:35.337162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:35.351223 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e4352eae-165f-4c4f-a41e-c33e11a353d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.200472 Aug 24 17:26:35.362983 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 48/104] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:35 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:35.878249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:35.879379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:35.887247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:35.887739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:35.888169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:35.888870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:35.889323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:35.889742 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:35.907731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:35.908464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:35.915237 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:35.916018 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:35.916203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:35.917515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:35.921000 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:35.921000 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:36.097281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:36.110541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9e2f2c41-c286-4747-9db8-c968bada0bb1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.241489 Aug 24 17:26:36.111380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 57/105] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:35 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:36.119951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:36.119951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:36.124091 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:36.124574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:36.125034 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:36.125725 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:36.126174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:36.126592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:36.127991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:36.147179 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-42a2cd70-0354-44a8-9028-01768f1f4c85 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.243767 Aug 24 17:26:36.161490 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 49/106] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:35 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:36.189032 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:36.189881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:36.208027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:36.209013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:36.209716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:36.210828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:36.211230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:36.211972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:36.212788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:36.220416 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-30be26bc-97e5-43c3-a36c-8d5482caf451 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1293 microversion: 2.1 time: 0.107107 Aug 24 17:26:36.221033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 58/107] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:36 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:36.373259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:36.373861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:36.380403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:36.381034 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:36.384790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:36.386455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:36.390258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:36.390480 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:36.391587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:36.400727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:36.416659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:36.416659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aa91a1fb-8899-40a4-8893-3ffa9600cccb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.222359 Aug 24 17:26:36.416659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 50/108] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:36 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:36.598380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:36.607121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-947afb96-c068-4744-a693-830c44ae31f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.237926 Aug 24 17:26:36.609866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 59/109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:36 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:37.134198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:37.135139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:37.144289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.147497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.148569 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.150189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.152617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.153124 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.169298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:37.170036 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:37.177039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.177531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.178129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.178946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.179564 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.180138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.371272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:37.387373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d981156-bc92-4df8-b8f3-529c913bdfc1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.258362 Aug 24 17:26:37.387559 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:37.388288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 51/110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:37 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:37.393129 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:37.393728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:37.402641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.403403 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.404047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.404896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.405501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.406086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.409360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-95d064f1-af36-4d91-8b75-2a8a0460f5b6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.244410 Aug 24 17:26:37.410119 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 60/111] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:37 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:37.414808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-a6630595-9792-49d9-b894-4850eaee59e0 req-3aae9a8d-984d-42b3-9e64-62178fa3161a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509a6e8e-d774-492b-9618-7de5caf2955f", "name": "network-vif-plugged", "status": "completed", "tag": "27819313-e232-4d79-a507-dd2f39913292"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:37.425287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a6630595-9792-49d9-b894-4850eaee59e0 req-3aae9a8d-984d-42b3-9e64-62178fa3161a service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.425761 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a6630595-9792-49d9-b894-4850eaee59e0 req-3aae9a8d-984d-42b3-9e64-62178fa3161a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.426861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a6630595-9792-49d9-b894-4850eaee59e0 req-3aae9a8d-984d-42b3-9e64-62178fa3161a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.445859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-a6630595-9792-49d9-b894-4850eaee59e0 req-3aae9a8d-984d-42b3-9e64-62178fa3161a service nova] Creating event network-vif-plugged:27819313-e232-4d79-a507-dd2f39913292 for instance 509a6e8e-d774-492b-9618-7de5caf2955f on hv-cinder-85164 Aug 24 17:26:37.455494 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-a6630595-9792-49d9-b894-4850eaee59e0 req-3aae9a8d-984d-42b3-9e64-62178fa3161a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043791 Aug 24 17:26:37.456691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 61/112] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:37.462755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:37.482419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:37.482419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.482419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.482419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.483127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.483127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.483127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.521208 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:37.533331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5372f46-01e1-41f1-9a81-1f7b52650eba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1293 microversion: 2.1 time: 0.143548 Aug 24 17:26:37.535337 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 52/113] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:37 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1293 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:37.628157 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:37.628791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:37.636768 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.637319 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.637865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.638639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:37.639356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:37.639781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:37.666680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:37.679995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:37.686370 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:37.686370 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-547953d3-7ad3-4a11-845d-3923046c0305 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.227807 Aug 24 17:26:37.687995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 62/114] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:37 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:37.786970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:37.795299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac22d89b-d730-46df-9799-aa887d9764fa tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.171185 Aug 24 17:26:37.795861 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 53/115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:37 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:38.407679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:38.408300 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:38.414542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.415065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.415507 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.416258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.416716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.417165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.447403 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:38.448901 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:38.456878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.457694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.458051 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.458500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.458981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.459446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.675654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:38.689957 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-56e94181-b011-43dc-86f0-df1e393a825e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.281301 Aug 24 17:26:38.690742 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 63/116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:38 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:38.696941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:38.701068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:38.710669 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.711222 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.711722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.712465 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.712988 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.713557 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.721113 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:38.738022 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a78b1aa4-038e-461f-bc91-c3276f517b60 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.289635 Aug 24 17:26:38.738706 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 54/117] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:38 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:38.760474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:38.761221 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:38.770759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.771611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.772467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.773284 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.773996 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.774646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.819486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:38.827615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bb0a93e1-60a8-49f8-ab9c-2b60b9c2718d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1293 microversion: 2.1 time: 0.135709 Aug 24 17:26:38.828918 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 64/118] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:38 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:38.835505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:38.836094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:38.847277 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.847778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.851633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.851633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:38.851633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:38.851633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:38.855204 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.084661 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:39.095725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:39.097854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:39.098646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bc7b6e4f-8485-412e-9517-efdc8f563b5f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.345604 Aug 24 17:26:39.099270 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 55/119] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:38 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:39.185754 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:39.201620 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6ebfcc57-4058-4b79-87d6-80145e865021 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.369304 Aug 24 17:26:39.202800 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 65/120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:38 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:39.716093 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:39.716795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:39.724168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:39.724913 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:39.730082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:39.730082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:39.730082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:39.730082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:39.762682 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:39.762682 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:39.770653 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:39.771184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:39.775287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:39.777389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:39.777886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:39.779694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:40.209318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:40.225276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:40.238246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6a384fd-40ad-4872-91ae-4f5d890d6f1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.511067 Aug 24 17:26:40.243785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 56/121] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:39 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:40.253349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-00888db8-2281-4688-b115-55e098fe461e tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.496516 Aug 24 17:26:40.253999 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 66/122] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:39 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:40.262728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:40.264969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:40.274500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:40.275921 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:40.286110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:40.286110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:40.291439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:40.291574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:40.291574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:40.291574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:40.295757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:40.297225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:40.297225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:40.297382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:40.297871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:40.298400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:40.418020 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:40.443967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a7345bcb-3d09-4cc2-8978-8ec1f06b5c63 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1311 microversion: 2.1 time: 0.194996 Aug 24 17:26:40.445023 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 57/123] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:40 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:40.470509 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:40.471157 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:40.477593 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:40.478729 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:40.478878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:40.479637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:40.480110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:40.480536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:40.727182 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:40.738490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:40.743161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:40.743161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b502e626-804b-49e3-81e0-67230c40ac08 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.483400 Aug 24 17:26:40.743161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 67/124] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:40 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:40.751475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:40.763484 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a1dbfb8-ab1a-4243-af63-9c8e50be7305 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.314016 Aug 24 17:26:40.766545 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 58/125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:40 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:40.826956 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-f2ec2524-bf7b-44e2-b62a-bc964f1f4e5c req-4fa62905-1260-42bf-ab20-adef18acad6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5542f65d-3efd-4dc6-9c28-ea9d8ac19317", "tag": "afddf061-f22c-4311-aa82-82860263ce79"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:40.860879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-f2ec2524-bf7b-44e2-b62a-bc964f1f4e5c req-4fa62905-1260-42bf-ab20-adef18acad6d service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:40.866489 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-f2ec2524-bf7b-44e2-b62a-bc964f1f4e5c req-4fa62905-1260-42bf-ab20-adef18acad6d service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:40.867911 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-f2ec2524-bf7b-44e2-b62a-bc964f1f4e5c req-4fa62905-1260-42bf-ab20-adef18acad6d service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:40.898403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-f2ec2524-bf7b-44e2-b62a-bc964f1f4e5c req-4fa62905-1260-42bf-ab20-adef18acad6d service nova] Creating event network-changed:afddf061-f22c-4311-aa82-82860263ce79 for instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 on hv-cinder-85164 Aug 24 17:26:40.904635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-f2ec2524-bf7b-44e2-b62a-bc964f1f4e5c req-4fa62905-1260-42bf-ab20-adef18acad6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091074 Aug 24 17:26:40.905469 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 68/126] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:41.271846 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:41.272964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:41.280595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.281104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.281543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.282639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.283247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.283757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.283870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:41.284834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:41.291991 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.293649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.294285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.295286 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.297445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.298119 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.773964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:41.775268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:41.787266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-655315b3-970f-4972-b6a0-3515e875ec84 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.514350 Aug 24 17:26:41.788457 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 69/127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:41 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:41.793697 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:41.794541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:41.801413 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.802263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.802985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.803911 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.804611 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.805225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.821714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad06c50c-6f26-49e1-95c4-b845e34520b0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.554569 Aug 24 17:26:41.822819 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 59/128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:41 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:41.846726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-dbbfcb1b-100f-47ee-b85b-677cef869914 req-9c5061ae-9508-4638-a699-a0484b0f857e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4358625-1c72-482d-8701-670df9093271", "name": "network-vif-plugged", "status": "completed", "tag": "0de6314b-7979-44ff-97cf-61fca7107b27"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:41.858089 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:41.861206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dbbfcb1b-100f-47ee-b85b-677cef869914 req-9c5061ae-9508-4638-a699-a0484b0f857e service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.861935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dbbfcb1b-100f-47ee-b85b-677cef869914 req-9c5061ae-9508-4638-a699-a0484b0f857e service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.863653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dbbfcb1b-100f-47ee-b85b-677cef869914 req-9c5061ae-9508-4638-a699-a0484b0f857e service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.886672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-dbbfcb1b-100f-47ee-b85b-677cef869914 req-9c5061ae-9508-4638-a699-a0484b0f857e service nova] Creating event network-vif-plugged:0de6314b-7979-44ff-97cf-61fca7107b27 for instance a4358625-1c72-482d-8701-670df9093271 on hv-cinder-85164 Aug 24 17:26:41.897111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-dbbfcb1b-100f-47ee-b85b-677cef869914 req-9c5061ae-9508-4638-a699-a0484b0f857e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071000 Aug 24 17:26:41.898132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 60/129] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:41.917788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:41.919343 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:41.927732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.929723 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.930707 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.933220 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.934209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.935827 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.946777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:41.959644 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3d368965-4ee5-474a-91d0-4dca240ad3b5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1299 microversion: 2.1 time: 0.169636 Aug 24 17:26:41.960760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 70/130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:41 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:41.981710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:41.983085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:41.990302 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.991218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.991887 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:41.992941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:41.993659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:41.994300 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:42.493464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:42.501268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:42.527737 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f1ef2a21-63d9-45f0-95e8-11d408bf1789 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.537265 Aug 24 17:26:42.528125 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:42.528296 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 71/131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:41 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:42.528441 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:42.528441 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a806aa50-895d-44c8-9bb1-f0a0f72eb19a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.624677 Aug 24 17:26:42.528441 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 61/132] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:41 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:42.819573 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:42.819573 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:42.824005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:42.824765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:42.825194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:42.826333 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:42.826333 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:42.827205 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:42.853453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:42.854209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:42.867368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:42.868252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:42.868800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:42.870748 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:42.872068 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:42.872853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:43.113130 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:43.121987 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:43.139532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-03a76012-90c2-4eb5-81a6-c77c62b52275 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1314 microversion: 2.1 time: 0.314371 Aug 24 17:26:43.141515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e2d35d9f-6832-4bcf-9c2e-601b1743d243 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.289578 Aug 24 17:26:43.145005 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 62/133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:42 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:43.152451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 72/134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:42 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:43.152618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:43.152618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:43.162437 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:43.162972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:43.163411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:43.164281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:43.164890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:43.165486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:43.183969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:43.330577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:43.345916 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-065c9895-1356-49b5-939e-ed10dbe41542 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.200363 Aug 24 17:26:43.347137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 63/135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:43 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:43.535192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:43.535816 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:43.542558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:43.544662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:43.544662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:43.544662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:43.544662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:43.545109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:43.567150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:43.568276 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:43.585702 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:43.586894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:43.586894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:43.587624 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:43.588086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:43.588515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:43.831981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:43.845592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-233cf47a-34d6-4069-8b78-18ac9aa2c9da tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.314363 Aug 24 17:26:43.859941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 73/136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:43 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:43.887375 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:43.899266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:43.900968 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:43.902300 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-61148b55-c219-4af4-8d61-45d01e890c11 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.355398 Aug 24 17:26:43.912006 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 64/137] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:43 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:43.961685 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-f3280d29-9fb9-42a7-8358-6ef99e5263aa req-49f7a171-ef3b-490d-a287-a4756f5dccab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483b254a-2178-420a-8a82-111e13dfaa7e", "name": "network-vif-plugged", "status": "completed", "tag": "55059be5-28aa-4c2b-8f3b-8e394679665a"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:43.976895 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-f3280d29-9fb9-42a7-8358-6ef99e5263aa req-49f7a171-ef3b-490d-a287-a4756f5dccab service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:43.978042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-f3280d29-9fb9-42a7-8358-6ef99e5263aa req-49f7a171-ef3b-490d-a287-a4756f5dccab service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:43.979171 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-f3280d29-9fb9-42a7-8358-6ef99e5263aa req-49f7a171-ef3b-490d-a287-a4756f5dccab service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.004966 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-f3280d29-9fb9-42a7-8358-6ef99e5263aa req-49f7a171-ef3b-490d-a287-a4756f5dccab service nova] Creating event network-vif-plugged:55059be5-28aa-4c2b-8f3b-8e394679665a for instance 483b254a-2178-420a-8a82-111e13dfaa7e on hv-cinder-85164 Aug 24 17:26:44.016368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-f3280d29-9fb9-42a7-8358-6ef99e5263aa req-49f7a171-ef3b-490d-a287-a4756f5dccab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056485 Aug 24 17:26:44.017767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 74/138] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:44.171943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:44.173675 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:44.175904 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:44.177433 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:44.180915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.181650 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.182282 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.183744 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.184600 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.185216 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.198957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.199873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.200572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.201615 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.202370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.203337 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.469762 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:44.477846 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:44.481985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-7f6ccb7a-b5d6-492e-ab6a-0576b9b031d3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.314750 Aug 24 17:26:44.482586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 75/139] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:44 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:44.486724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3cef627b-51a7-4dcb-9962-52a5adcc87f8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1502 microversion: 2.1 time: 0.318724 Aug 24 17:26:44.495264 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 65/140] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:44 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:44.495449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-babe87bb-9660-4697-ae20-97584073757a req-c2249df2-a934-4dd6-baf0-ff32edf37365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b97103-4f8f-4e11-aadd-a589dac7490e", "tag": "50697787-0e63-4fda-826f-14d5ab0209ee"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:44.495547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:44.495547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:44.500093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:44.501598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.502089 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.502567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.502722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-babe87bb-9660-4697-ae20-97584073757a req-c2249df2-a934-4dd6-baf0-ff32edf37365 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.503586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-babe87bb-9660-4697-ae20-97584073757a req-c2249df2-a934-4dd6-baf0-ff32edf37365 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.503801 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.504498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.504917 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-babe87bb-9660-4697-ae20-97584073757a req-c2249df2-a934-4dd6-baf0-ff32edf37365 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.505027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.522194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-babe87bb-9660-4697-ae20-97584073757a req-c2249df2-a934-4dd6-baf0-ff32edf37365 service nova] Creating event network-changed:50697787-0e63-4fda-826f-14d5ab0209ee for instance 95b97103-4f8f-4e11-aadd-a589dac7490e on hv-cinder-85164 Aug 24 17:26:44.528896 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-babe87bb-9660-4697-ae20-97584073757a req-c2249df2-a934-4dd6-baf0-ff32edf37365 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044320 Aug 24 17:26:44.530348 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 76/141] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:44.694976 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:44.704160 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-499d7ba1-c6a0-4b20-bfa5-ea20b571bc1e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.215429 Aug 24 17:26:44.704756 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 66/142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:44 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:44.870548 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:44.871288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:44.879142 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.879691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.880169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.880978 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.881473 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.882036 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.925836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:44.926546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:44.940196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.940834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.941268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:44.947284 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:44.947872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:44.948859 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:45.200491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:45.205780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:45.225230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:45.235475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:45.236652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99f89a24-ba22-438d-9e3e-83957308f744 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.314956 Aug 24 17:26:45.237244 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 67/143] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:44 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:26:45.240236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-962711e0-b7c9-4fb1-a432-ca11e8f850ee tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.374208 Aug 24 17:26:45.241511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 77/144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:44 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:45.530680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:45.532194 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:45.546671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:45.547607 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:45.548471 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:45.549672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:45.551096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:45.551614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:45.729107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:45.730750 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:45.741251 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:45.742062 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:45.742928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:45.744142 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:45.745550 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:45.746234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:45.777631 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:45.785981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-291bfb58-ecb0-4203-8874-2216c1a558fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.284601 Aug 24 17:26:45.786560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 68/145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:45 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:45.908327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:45.917250 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-73b703d1-5643-4b51-8d54-cb8bb9de1728 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.194881 Aug 24 17:26:45.917841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 78/146] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:45 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:46.263880 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:46.265106 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:46.272540 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:46.276472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:46.277296 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:46.282965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:46.282965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:46.282965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:46.282965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:46.284052 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:46.297165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:46.298042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:46.298806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:46.300101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:46.300900 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:46.301850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:46.531568 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:46.536492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:46.547991 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:46.550321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3ba6a705-4b3a-4981-bd9b-458c531d0cec tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.292456 Aug 24 17:26:46.551432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:46.553433 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2ad4a071-9828-4e80-8047-fcd2d8a1f072 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.292880 Aug 24 17:26:46.556025 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 79/147] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:46 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:26:46.557949 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 69/148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:46 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:46.811818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:46.811818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:46.819496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:46.820333 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:46.821087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:46.822321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:46.823933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:46.824615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:46.962537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:46.963198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:46.970352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:46.970846 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:46.971464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:46.972229 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:46.972726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:46.973217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:47.038371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:47.058880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f1ae3547-77e6-4271-a2ae-d3c36aac1d46 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.255628 Aug 24 17:26:47.063158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 80/149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:46 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:47.223279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:47.232267 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c0f6cf78-cdab-4a89-aa68-0256fcdf2a1c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.286358 Aug 24 17:26:47.232891 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 70/150] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:46 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:47.581710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:47.583611 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:47.589188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:47.589879 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:47.592549 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:47.593358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:47.593996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:47.596177 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:47.597338 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:47.598091 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:47.599990 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:47.600475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:47.601054 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:47.601751 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:47.607807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:47.607807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:47.820294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:47.830206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:47.835950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aafeb9c0-493a-4cd8-800c-8191a2f04d3c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.259459 Aug 24 17:26:47.837585 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 71/151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:47 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:47.845275 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2fb11b75-2b60-47df-95de-1b6badbd26e5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11e5ac5c-dfdc-4b9a-8b0c-264b77265522"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:47.848360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2fb11b75-2b60-47df-95de-1b6badbd26e5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:47.855388 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb11b75-2b60-47df-95de-1b6badbd26e5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:47.856136 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb11b75-2b60-47df-95de-1b6badbd26e5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:47.856567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb11b75-2b60-47df-95de-1b6badbd26e5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:47.857269 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb11b75-2b60-47df-95de-1b6badbd26e5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:47.857713 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb11b75-2b60-47df-95de-1b6badbd26e5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:47.858148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:47.858270 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2fb11b75-2b60-47df-95de-1b6badbd26e5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:47.862284 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:47.874720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d75abd05-519c-4803-aa5e-78a09b808b04 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.288553 Aug 24 17:26:47.874720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 81/152] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:47 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:48.083206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:48.083787 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:48.091841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:48.092465 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:48.093079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:48.093944 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:48.094580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:48.095257 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:48.258277 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:48.280626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3f11d579-ba76-48d3-81a0-a17a5f33edd2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.200935 Aug 24 17:26:48.281847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 82/153] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:48 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:48.290353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:48.291489 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:48.302531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:48.303459 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:48.304212 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:48.305433 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:48.306263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:48.307083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:48.578805 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:48.586057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:48.596301 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-52967c04-5606-4842-b564-2341eebd2e55 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.312524 Aug 24 17:26:48.597700 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 83/154] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:48 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:48.862484 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:48.863514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:48.875046 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:48.875834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:48.876563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:48.877917 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:48.878549 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:48.879294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:49.121109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:49.131530 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-54a5e1f6-7ec6-4d0a-84d0-f473321909be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1364 microversion: 2.1 time: 0.275617 Aug 24 17:26:49.132403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 84/155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:48 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:49.137869 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:49.138716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:49.147686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:49.148319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:49.148880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:49.149672 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:49.150219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:49.151923 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:49.346299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:49.362816 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:49.365908 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:49.368166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5a575737-67b0-4979-95cd-aeb3e7a777f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.234088 Aug 24 17:26:49.369095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 85/156] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:49 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:49.378055 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:49.381356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:49.397505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:49.398359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:49.399149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:49.400385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:49.401854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:49.402604 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:49.634730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:49.651237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a2be5d33-a3e5-4c46-9dde-4c0942b0ad79 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1322 microversion: 2.1 time: 0.280107 Aug 24 17:26:49.665503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 86/157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:49 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:49.671589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:49.672701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:49.683965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:49.684645 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:49.695081 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:49.695081 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:49.695081 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:49.695081 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:49.935097 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:49.952275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-83fbc02a-740d-4cf3-992e-f532fbfef1cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.283833 Aug 24 17:26:49.953629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 87/158] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:49 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:50.163701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:50.164662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:50.176228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:50.178214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:50.178915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:50.179882 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:50.180722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:50.181451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:50.451671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:50.464628 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8304cc21-43d1-4038-bfcb-87ec4a03603f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1550 microversion: 2.1 time: 0.305552 Aug 24 17:26:50.465284 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 88/159] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:50 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1550 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:50.471290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:50.472301 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:50.481724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:50.483328 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:50.484082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:50.488354 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:50.489368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:50.490126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:50.690608 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:50.732351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:50.734391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:50.735775 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-17f22819-18f5-4270-a8c9-cbce8aad832e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.269382 Aug 24 17:26:50.737501 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 89/160] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:50 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:50.743743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-89dec139-3f46-406b-8cae-07fa66f4a82a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:50.744794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-89dec139-3f46-406b-8cae-07fa66f4a82a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:50.753855 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89dec139-3f46-406b-8cae-07fa66f4a82a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:50.754804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89dec139-3f46-406b-8cae-07fa66f4a82a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:50.755838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89dec139-3f46-406b-8cae-07fa66f4a82a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:50.757315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89dec139-3f46-406b-8cae-07fa66f4a82a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:50.758349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89dec139-3f46-406b-8cae-07fa66f4a82a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:50.759245 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89dec139-3f46-406b-8cae-07fa66f4a82a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:50.986312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-89dec139-3f46-406b-8cae-07fa66f4a82a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.248622 Aug 24 17:26:50.986928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 90/161] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 24 17:26:50 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/os-interface => generated 285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:50.994313 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:50.995838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:51.007748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:51.008618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:51.009861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:51.012490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:51.013281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:51.015086 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:51.478990 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:51.487189 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6e6a00fe-937b-4bdf-8ac1-0ea2ecb9680a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1516 microversion: 2.1 time: 0.499174 Aug 24 17:26:51.495927 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 91/162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:50 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1516 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:51.503775 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:51.505078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:51.512099 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:51.512586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:51.513020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:51.513709 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:51.514166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:51.514676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:51.729791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2fb11b75-2b60-47df-95de-1b6badbd26e5 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "POST /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.889587 Aug 24 17:26:51.730686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 72/163] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:26:47 2022] POST /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33/os-volume_attachments => generated 194 bytes in 3892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:51.736263 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:51.738804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:51.748637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:51.749553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:51.750490 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:51.751756 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:51.752586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:51.755321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:51.804615 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lazy-loading 'flavor' on Instance uuid a4358625-1c72-482d-8701-670df9093271 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:26:52.230580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:52.241658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a350029f-2d3c-445c-be94-f8c976367017 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.742772 Aug 24 17:26:52.260755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 92/164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:51 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:52.260755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:52.260755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:52.260755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:52.261374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:52.261374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:52.261374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:52.261374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:52.267966 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:52.446226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-54955cdf-0f32-459e-9a1d-5a7114dc26d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271/action" status: 200 len: 32 microversion: 2.1 time: 0.713559 Aug 24 17:26:52.449680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 73/165] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:26:51 2022] POST /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271/action => generated 32 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:26:52.462249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:52.463654 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:52.475812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:52.477136 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:52.477677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:52.479052 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:52.479831 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:52.480543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:52.673943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:52.690845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:52.694008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:52.696384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bb97b9f7-5b19-49d2-b50f-4ec927648d33 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.452757 Aug 24 17:26:52.697345 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 93/166] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:52 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:52.841625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:52.865614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e943617-73c9-46a1-b22d-8d7d0c6bd006 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.409882 Aug 24 17:26:52.866506 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 74/167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:52 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:53.276072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:53.277085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:53.303056 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:53.303962 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:53.311312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:53.312871 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:53.313362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:53.315949 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:53.401204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1a691b0c-3188-45c9-af9f-5caf723d8167 req-ec343b58-289d-452a-9d15-d92327ee0441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483b254a-2178-420a-8a82-111e13dfaa7e", "tag": "55059be5-28aa-4c2b-8f3b-8e394679665a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:53.420111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1a691b0c-3188-45c9-af9f-5caf723d8167 req-ec343b58-289d-452a-9d15-d92327ee0441 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:53.420898 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1a691b0c-3188-45c9-af9f-5caf723d8167 req-ec343b58-289d-452a-9d15-d92327ee0441 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:53.421633 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1a691b0c-3188-45c9-af9f-5caf723d8167 req-ec343b58-289d-452a-9d15-d92327ee0441 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:53.443877 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1a691b0c-3188-45c9-af9f-5caf723d8167 req-ec343b58-289d-452a-9d15-d92327ee0441 service nova] Creating event network-changed:55059be5-28aa-4c2b-8f3b-8e394679665a for instance 483b254a-2178-420a-8a82-111e13dfaa7e on hv-cinder-85164 Aug 24 17:26:53.470370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1a691b0c-3188-45c9-af9f-5caf723d8167 req-ec343b58-289d-452a-9d15-d92327ee0441 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072263 Aug 24 17:26:53.472927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 75/168] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:26:53.679365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:53.693797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4ccd3c02-98b1-4ddb-9906-a1f382278d0f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.425156 Aug 24 17:26:53.697966 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 94/169] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:53 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:53.723327 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:53.723543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:53.746539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:53.747563 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:53.752954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:53.755315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:53.759289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:53.761311 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:53.915294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:53.924826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:53.965031 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:53.966300 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:53.967806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:53.969047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:53.970043 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:53.971695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:54.084669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:54.107828 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:54.109057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:54.110462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-45292d13-c7a5-4855-91ac-246a319cdd86 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.392940 Aug 24 17:26:54.123295 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 76/170] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:53 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:54.361023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:54.382832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b9c7752a-ba63-458c-ab3d-03201efa4d5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.481891 Aug 24 17:26:54.384038 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 95/171] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:53 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:54.733272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:54.734461 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:54.745961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:54.746563 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:54.747291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:54.748549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:54.749522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:54.750187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:54.768602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:55.141755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:55.145782 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:55.161089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:55.208988 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:55.212257 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:55.212505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:55.222137 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:55.223442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:55.264719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:55.306643 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6fd50b3-2ba3-4c1b-b3f6-00c72e3e3f54 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.580288 Aug 24 17:26:55.308357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 77/172] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:54 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:55.435500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:55.440629 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:55.453000 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:55.453402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:55.453853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:55.454826 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:55.455376 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:55.455813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:55.502684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:55.588063 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:55.600055 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:55.603394 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d2261f0a-2795-4f18-ba92-a2dbf7a3175c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.469055 Aug 24 17:26:55.605384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 96/173] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:55 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:26:55.786417 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:55.796017 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78302253-2b95-4170-946d-e34c72361c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.368090 Aug 24 17:26:55.796634 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 78/174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:55 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:56.344203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:56.344203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:56.344203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:56.344203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:56.344589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:56.345190 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:56.345914 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:56.346407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:56.535100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:56.546121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a87fd35d-2dbb-461f-bc71-1acd412bec5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.219613 Aug 24 17:26:56.547205 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 97/175] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:56 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:56.649311 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:56.651977 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:56.665256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:56.666400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:56.667469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:56.668943 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:56.670011 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:56.670744 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:56.833952 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:56.835122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:56.846539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:56.848725 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:56.849561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:56.850824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:56.851704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:56.852444 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:56.889988 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:56.897903 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:56.899937 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:56.902370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eae7d4e7-516b-48f6-871a-4aa223c665c4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.262154 Aug 24 17:26:56.903521 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 79/176] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:56 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:57.068334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:57.079566 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b8dc4046-22ce-4527-bc13-3fe04c04c984 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.251015 Aug 24 17:26:57.079566 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 98/177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:56 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:57.583725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:57.584424 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:57.591633 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:57.599003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:57.599003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:57.599003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:57.599003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:57.599553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:57.749683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-0a4744af-486f-4999-b218-1ae5ffd8d3a2 req-b041b479-5301-404c-90cb-8dc88f301167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5542f65d-3efd-4dc6-9c28-ea9d8ac19317", "name": "network-vif-plugged", "status": "completed", "tag": "afddf061-f22c-4311-aa82-82860263ce79"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:26:57.759351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-0a4744af-486f-4999-b218-1ae5ffd8d3a2 req-b041b479-5301-404c-90cb-8dc88f301167 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:57.760084 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-0a4744af-486f-4999-b218-1ae5ffd8d3a2 req-b041b479-5301-404c-90cb-8dc88f301167 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:57.761060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-0a4744af-486f-4999-b218-1ae5ffd8d3a2 req-b041b479-5301-404c-90cb-8dc88f301167 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:57.782312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-0a4744af-486f-4999-b218-1ae5ffd8d3a2 req-b041b479-5301-404c-90cb-8dc88f301167 service nova] Creating event network-vif-plugged:afddf061-f22c-4311-aa82-82860263ce79 for instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 on hv-cinder-85164 Aug 24 17:26:57.792223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-0a4744af-486f-4999-b218-1ae5ffd8d3a2 req-b041b479-5301-404c-90cb-8dc88f301167 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045660 Aug 24 17:26:57.793402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 99/178] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:26:57.839353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:57.850480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dbd90467-cdc8-4e91-a95a-940652178da0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.271605 Aug 24 17:26:57.855365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 80/179] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:57 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:57.961355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:57.962068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:57.970786 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:57.971362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:57.972027 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:57.972884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:57.973396 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:57.973814 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:58.104956 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:58.105923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:58.112936 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:58.113560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:58.114188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:58.115195 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:58.115654 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:58.116166 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:58.191964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:58.209590 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:58.211646 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:58.213009 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fb90b5ab-9e07-4317-ac7b-c1d944176b57 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.268294 Aug 24 17:26:58.215361 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 100/180] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:57 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:58.338161 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:58.348847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb5600c9-b536-4568-b926-ff5761a5e60a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.250401 Aug 24 17:26:58.356554 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 81/181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:58 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:26:58.883332 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:58.884019 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:58.891510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:58.892390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:58.892826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:58.893528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:58.894102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:58.894801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:58.929074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:59.152650 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:59.164266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ef45c88a-6212-41c2-ac25-65cff42f46cc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.284710 Aug 24 17:26:59.165093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 101/182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:58 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:26:59.252585 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:59.253637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:59.263200 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:59.270844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:59.270844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:59.270844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:59.270844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:59.271459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:59.373118 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:26:59.373774 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:26:59.380037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:59.380746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:59.381462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:59.382120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:26:59.382795 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:26:59.383794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:26:59.466790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:59.478599 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:59.481899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:59.483846 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b234c558-1576-4e0f-84d2-97a921cd590a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.236289 Aug 24 17:26:59.484807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 82/183] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:26:59 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:26:59.549754 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:26:59.569915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-caaed1ab-dfed-4fac-a499-a3b7016d47a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.199182 Aug 24 17:26:59.569915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 102/184] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:26:59 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:00.196722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:00.197340 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:00.207962 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:00.215292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:00.215292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:00.215292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:00.215292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:00.215919 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:00.424772 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:00.433368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5b76f443-8997-4093-99b8-bb739e774e82 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.240738 Aug 24 17:27:00.434139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 83/185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:00 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:00.508384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:00.509352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:00.517586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:00.518093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:00.518567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:00.519308 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:00.519804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:00.520225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:00.592035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:00.603488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:00.603488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:00.603488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:00.603488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:00.603904 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:00.603904 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:00.604326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:00.718653 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:00.730610 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:00.732561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:00.733886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d47fa360-4427-4718-8bf0-e93a53289395 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.229721 Aug 24 17:27:00.734642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 103/186] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:27:00 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:27:00.792544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:00.801659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a96cbd39-a63e-4fe7-b13e-ea47db1b3bde tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.216799 Aug 24 17:27:00.802705 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 84/187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:00 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:01.467422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:01.468417 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:01.484818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:01.488214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:01.491900 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:01.493165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:01.493807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:01.498632 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:01.765628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:01.771929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:01.800886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:01.801398 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:01.802066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:01.802890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:01.803610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:01.804145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:01.865495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:01.875553 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1a116ff2-ebdf-4407-8e77-d0e66b2ab879 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.423848 Aug 24 17:27:01.889037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 104/188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:01 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:01.889037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:01.889037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:01.889037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:01.898178 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:01.898178 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:01.898178 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:01.898178 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:01.898777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:02.212633 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:02.220994 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:02.228727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:02.232766 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:02.235235 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cfeb6974-1c23-4a6c-beeb-cc32ce4e44bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.475957 Aug 24 17:27:02.235555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-131c88da-506e-4ee4-9946-99d5ecd15b3a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.357761 Aug 24 17:27:02.236459 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 105/189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:01 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:02.237761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 85/190] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:27:01 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:27:02.916539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:02.917491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:02.927885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:02.928627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:02.930151 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:02.930945 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:02.933906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:02.934501 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:02.964518 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-dbe70be0-0788-4802-bf37-bf8110712236 req-28608c33-cf5f-49a7-813e-592b879d1922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b97103-4f8f-4e11-aadd-a589dac7490e", "name": "network-vif-plugged", "status": "completed", "tag": "50697787-0e63-4fda-826f-14d5ab0209ee"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:27:02.996781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dbe70be0-0788-4802-bf37-bf8110712236 req-28608c33-cf5f-49a7-813e-592b879d1922 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:03.004704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dbe70be0-0788-4802-bf37-bf8110712236 req-28608c33-cf5f-49a7-813e-592b879d1922 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:03.004704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-dbe70be0-0788-4802-bf37-bf8110712236 req-28608c33-cf5f-49a7-813e-592b879d1922 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:03.009513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-dbe70be0-0788-4802-bf37-bf8110712236 req-28608c33-cf5f-49a7-813e-592b879d1922 service nova] Creating event network-vif-plugged:50697787-0e63-4fda-826f-14d5ab0209ee for instance 95b97103-4f8f-4e11-aadd-a589dac7490e on hv-cinder-85164 Aug 24 17:27:03.015757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-dbe70be0-0788-4802-bf37-bf8110712236 req-28608c33-cf5f-49a7-813e-592b879d1922 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057491 Aug 24 17:27:03.016625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 86/191] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:27:03.190440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:03.214385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b6d2dcb2-fe07-4b7d-a58b-94c4fc81a2ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.297284 Aug 24 17:27:03.215613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 106/192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:02 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:03.264462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:03.265474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:03.273852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:03.274817 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:03.276242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:03.276641 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:03.276916 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:03.277959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:03.278625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:03.279287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:03.287221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:03.288437 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:03.289070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:03.290326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:03.292355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:03.293141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:03.598511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:03.622517 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:03.626719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:03.627689 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:03.629254 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a2550c44-ced0-4015-a485-68705a58c0f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.371261 Aug 24 17:27:03.643422 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 87/193] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:27:03 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:27:03.664853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2e1432d4-a7c8-4916-a453-a8e2c8e3d546 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.396483 Aug 24 17:27:03.666068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 107/194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:03 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:04.248674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:04.252637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:04.272359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:04.272852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:04.273296 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:04.274415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:04.275075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:04.278315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:04.511532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:04.524181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-608aa8e6-36e1-4a05-8c0e-57feed3e9db5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.287451 Aug 24 17:27:04.527915 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 88/195] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:04 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:04.670580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:04.671791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:04.682795 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:04.683232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:04.683666 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:04.684368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:04.684820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:04.685244 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:04.698185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:04.699774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:04.708182 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:04.709610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:04.710052 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:04.710994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:04.711763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:04.712069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:04.952035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:04.967535 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:04.969448 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:04.973705 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:04.975088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-602dc183-fc76-491a-983e-df5a5f55aa13 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1405 microversion: 2.20 time: 0.311340 Aug 24 17:27:04.976073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 108/196] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:27:04 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:27:04.997825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-486233f1-251a-464e-ae99-a5edc3e69a1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.306909 Aug 24 17:27:05.001369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 89/197] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:04 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:05.566344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:05.570072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:05.585499 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:05.588971 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:05.590017 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:05.591275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:05.592155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:05.592925 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:05.774153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:05.788183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8b298c21-2096-4361-a639-ba456c3c569e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.235281 Aug 24 17:27:05.788887 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 109/198] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:05 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:06.002149 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:06.003286 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:06.015413 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:06.016532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:06.017303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:06.018601 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:06.019422 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:06.020065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:06.031729 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:06.033241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:06.043537 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:06.045956 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:06.046598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:06.048977 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:06.048977 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:06.049571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:06.297596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:06.307913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:06.309571 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:06.312128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:06.314527 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d1a2633-7242-44b6-bd1b-ca5461e4d965 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1598 microversion: 2.20 time: 0.319129 Aug 24 17:27:06.315647 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 90/199] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:27:05 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1598 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:27:06.316455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5d211a8c-30e0-40f0-9cd2-83efb6b45df5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.291133 Aug 24 17:27:06.317041 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 110/200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:06 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:06.345508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4f6385df-adfe-473b-8b34-98664a07a855 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:06.346393 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4f6385df-adfe-473b-8b34-98664a07a855 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:06.358124 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f6385df-adfe-473b-8b34-98664a07a855 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:06.359878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f6385df-adfe-473b-8b34-98664a07a855 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:06.360074 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f6385df-adfe-473b-8b34-98664a07a855 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:06.361299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f6385df-adfe-473b-8b34-98664a07a855 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:06.361930 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f6385df-adfe-473b-8b34-98664a07a855 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:06.362370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4f6385df-adfe-473b-8b34-98664a07a855 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:06.490813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4f6385df-adfe-473b-8b34-98664a07a855 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.153052 Aug 24 17:27:06.492088 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 91/201] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Aug 24 17:27:06 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:27:06.814949 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:06.815704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:06.821975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:06.823122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:06.823511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:06.824268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:06.824727 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:06.825172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:07.147973 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:07.165579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e8173096-02e9-4537-b72b-7f7f90873bb8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.354188 Aug 24 17:27:07.167052 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 111/202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:06 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:07.339989 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:07.340884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:07.349414 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:07.350402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:07.351203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:07.352816 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:07.353275 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:07.353970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:07.868970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:07.878611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d97300c3-f40b-43e9-89fb-a968876f2ac6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.543742 Aug 24 17:27:07.879509 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 92/203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:07 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:08.211834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:08.211834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:08.218575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:08.219233 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:08.219734 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:08.220504 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:08.221019 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:08.221528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:08.279811 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d511653c-3de6-4ee3-97d4-2b19eec24304 req-64b578e9-9bc3-49be-993a-523fc0d2c1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5542f65d-3efd-4dc6-9c28-ea9d8ac19317", "tag": "afddf061-f22c-4311-aa82-82860263ce79"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:27:08.294496 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d511653c-3de6-4ee3-97d4-2b19eec24304 req-64b578e9-9bc3-49be-993a-523fc0d2c1a8 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:08.295804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d511653c-3de6-4ee3-97d4-2b19eec24304 req-64b578e9-9bc3-49be-993a-523fc0d2c1a8 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:08.297287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d511653c-3de6-4ee3-97d4-2b19eec24304 req-64b578e9-9bc3-49be-993a-523fc0d2c1a8 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:08.315012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d511653c-3de6-4ee3-97d4-2b19eec24304 req-64b578e9-9bc3-49be-993a-523fc0d2c1a8 service nova] Creating event network-changed:afddf061-f22c-4311-aa82-82860263ce79 for instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 on hv-cinder-85164 Aug 24 17:27:08.323326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d511653c-3de6-4ee3-97d4-2b19eec24304 req-64b578e9-9bc3-49be-993a-523fc0d2c1a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048567 Aug 24 17:27:08.325167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 93/204] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:27:08.454627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:08.470561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-70c6bf92-8de4-41ff-98b6-fee06a131c48 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.272795 Aug 24 17:27:08.487565 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 112/205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:08 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:08.909222 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:08.910516 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:08.923467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:08.924421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:08.925217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:08.926469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:08.927346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:08.928115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:09.158045 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:09.168990 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-440c80d4-b59f-42f4-9726-2aeae654e7c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.267955 Aug 24 17:27:09.169718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 94/206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:08 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:09.504662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:09.505806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:09.513816 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:09.514436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:09.515025 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:09.515898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:09.516772 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:09.517297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:09.716183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:09.725743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-386b2b9d-45a6-4fa8-bc83-edfa97bcde33 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.225806 Aug 24 17:27:09.726355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 113/207] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:09 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:10.198315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:10.199205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:10.206118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:10.206651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:10.207196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:10.207947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:10.208443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:10.208911 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:10.380401 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:10.383024 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:10.390516 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-daf03033-7406-4e66-b7bf-73736522dc8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.196433 Aug 24 17:27:10.391449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 95/208] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:10 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:10.761253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:10.762029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:10.768687 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:10.769238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:10.769677 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:10.770373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:10.770836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:10.771298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:10.919071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:10.927885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-709d76a2-6505-4857-9ebc-5fb4159eec56 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.171511 Aug 24 17:27:10.928474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 114/209] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:10 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:11.414942 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:11.415959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:11.423439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:11.423985 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:11.424361 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:11.425045 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:11.425492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:11.425912 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:11.581269 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:11.591283 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27968c81-737d-49ad-92fc-c7f5013fc10c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.181350 Aug 24 17:27:11.591860 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 96/210] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:11 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:11.953099 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:11.954047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:11.962543 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:11.963061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:11.963490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:11.964180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:11.964626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:11.965041 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:12.118665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:12.130799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-92188232-39e2-4ce5-93a0-72d59e81a7a2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.184612 Aug 24 17:27:12.131770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 115/211] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:11 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:12.613776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:12.614532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:12.621732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:12.622265 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:12.623015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:12.623761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:12.624256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:12.624718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:12.784353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:12.793031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ab0505b-f0ea-4dad-b474-15e63c5bef06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.183250 Aug 24 17:27:12.793888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 97/212] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:12 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:13.159450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:13.160078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:13.167165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:13.167660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:13.168097 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:13.168799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:13.169254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:13.169676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:13.322389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:13.332310 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5099acea-ab82-433f-b243-8d6c209c65f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.177093 Aug 24 17:27:13.333258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 116/213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:13 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:13.818821 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:13.819792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:13.823229 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=75 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:13.829950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:13.830674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:13.831423 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:13.832486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:13.833284 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:13.833936 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:13.996066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:14.004921 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4322dc2e-7469-4634-94b5-c2f81aacc6b7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.191715 Aug 24 17:27:14.005562 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 98/214] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:13 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:14.358487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:14.359616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:14.370415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:14.371317 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:14.372087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:14.373282 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:14.374078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:14.374773 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:14.572674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:14.583096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a3c7c34e-f284-4e96-b2c6-ecbd6fd2dd85 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.231438 Aug 24 17:27:14.583788 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 117/215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:14 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:15.041609 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:15.042592 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:15.050203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:15.050850 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:15.051422 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:15.052234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:15.052786 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:15.053297 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:15.213272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:15.224289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dbb592f0-75ee-42da-ae17-a5746f387163 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.187230 Aug 24 17:27:15.225721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 99/216] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:15 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:15.615172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:15.616278 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:15.627481 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:15.628354 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:15.632145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:15.632145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:15.632145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:15.632145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:15.639138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:15.812054 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:15.821274 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-feb6a590-98bc-4ac8-965f-b12073b77d0d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1367 microversion: 2.1 time: 0.211852 Aug 24 17:27:15.821935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 118/217] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:15 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:16.257363 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:16.258094 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:16.266122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:16.266860 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:16.270209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:16.270209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:16.270209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:16.270209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:16.497927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:16.512539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11f73d07-9b87-4990-b764-b7365110593e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.259203 Aug 24 17:27:16.513318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 100/218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:16 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:16.846946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:16.848138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:16.851904 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=85 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:16.862354 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:16.863127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:16.863741 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:16.864974 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:16.865909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:16.866611 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:17.092898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:17.102360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9c2c413b-4a9e-4372-adb3-a95e87cbceb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1555 microversion: 2.1 time: 0.261396 Aug 24 17:27:17.102972 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 119/219] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:16 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:17.128975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a39fcfb8-2f40-418e-b3c3-ffa9278e7273 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:17.129549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a39fcfb8-2f40-418e-b3c3-ffa9278e7273 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:17.139181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39fcfb8-2f40-418e-b3c3-ffa9278e7273 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:17.139742 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39fcfb8-2f40-418e-b3c3-ffa9278e7273 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:17.141080 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39fcfb8-2f40-418e-b3c3-ffa9278e7273 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:17.142076 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39fcfb8-2f40-418e-b3c3-ffa9278e7273 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:17.142535 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39fcfb8-2f40-418e-b3c3-ffa9278e7273 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:17.142979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a39fcfb8-2f40-418e-b3c3-ffa9278e7273 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:17.250082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a39fcfb8-2f40-418e-b3c3-ffa9278e7273 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124744 Aug 24 17:27:17.251163 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 101/220] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 24 17:27:17 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:27:17.538375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:17.539396 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:17.548138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:17.548847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:17.549663 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:17.550555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:17.551196 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:17.551929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:17.854937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:17.868064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0cae5333-c33c-44a2-8641-d25c97306723 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.334045 Aug 24 17:27:17.868664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 120/221] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:17 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:18.795610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-95a3887f-4142-4748-8028-7d8732582aa9 req-810402a6-1e38-430f-83cf-1e9c7250d80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b97103-4f8f-4e11-aadd-a589dac7490e", "tag": "50697787-0e63-4fda-826f-14d5ab0209ee"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:27:18.811572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-95a3887f-4142-4748-8028-7d8732582aa9 req-810402a6-1e38-430f-83cf-1e9c7250d80b service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:18.812664 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-95a3887f-4142-4748-8028-7d8732582aa9 req-810402a6-1e38-430f-83cf-1e9c7250d80b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:18.813610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-95a3887f-4142-4748-8028-7d8732582aa9 req-810402a6-1e38-430f-83cf-1e9c7250d80b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:18.906123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:18.912200 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:18.924492 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:18.925566 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:18.926387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:18.927738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:18.928572 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:18.929592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:18.979570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-95a3887f-4142-4748-8028-7d8732582aa9 req-810402a6-1e38-430f-83cf-1e9c7250d80b service nova] Creating event network-changed:50697787-0e63-4fda-826f-14d5ab0209ee for instance 95b97103-4f8f-4e11-aadd-a589dac7490e on hv-cinder-85164 Aug 24 17:27:18.982776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-95a3887f-4142-4748-8028-7d8732582aa9 req-810402a6-1e38-430f-83cf-1e9c7250d80b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193268 Aug 24 17:27:18.984592 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 102/222] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:27:19.177139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:19.191485 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-219b51fc-55f4-4ede-ad66-deb3953cf544 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.293488 Aug 24 17:27:19.198318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 121/223] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:18 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:19.807562 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:19.820145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:19.820145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:19.820145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:19.820145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:19.820646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:19.820646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:19.820646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:19.896709 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:27:20.224359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:20.225468 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:20.236221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:20.237234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:20.239756 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:20.239756 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:20.241086 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:20.242048 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:20.290568 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99b01648-f796-4b6b-b746-99158a04cc75 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 204 len: 0 microversion: 2.1 time: 0.489165 Aug 24 17:27:20.292440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 103/224] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:27:19 2022] DELETE /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:27:20.309036 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:20.310390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:20.321533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:20.325881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:20.325881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:20.325881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:20.325881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:20.326615 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:20.598470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:20.611047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-78bed678-dc32-43e2-b98b-2ed9a22c7185 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.390596 Aug 24 17:27:20.612330 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 122/225] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:20 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:20.645804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:20.660219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-28c97c45-51f5-42f5-ae53-678fe25f70d4 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1554 microversion: 2.1 time: 0.358855 Aug 24 17:27:20.660944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 104/226] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:20 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1554 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:21.641833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:21.645750 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:21.650946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:21.651671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:21.652295 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:21.653195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:21.653655 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:21.654075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:21.696853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:21.699616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:21.710738 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:21.711616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:21.712604 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:21.713693 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:21.715155 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:21.715780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:22.292877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:22.295730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:22.310678 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1699c05b-37e8-440e-9492-d986a400c2c9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1554 microversion: 2.1 time: 0.620985 Aug 24 17:27:22.311899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 105/227] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:21 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1554 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:22.328466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-af74fe6b-c43d-425e-9616-ade50f65f388 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.690736 Aug 24 17:27:22.329094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 123/228] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:21 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:23.334134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:23.334747 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:23.345602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:23.346807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:23.347873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:23.349479 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:23.350545 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:23.351336 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:23.363400 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:23.365454 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:23.376159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:23.377385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:23.378578 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:23.380089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:23.381222 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:23.382176 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:23.594600 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:23.601783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9036d5c7-5e1c-4824-bc85-4e3fa63f5135 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1554 microversion: 2.1 time: 0.271656 Aug 24 17:27:23.604964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 106/229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:23 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:23.651717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:23.667107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-24ff545b-82eb-4f7b-b023-1308450d08be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.310705 Aug 24 17:27:23.668028 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 124/230] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:23 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:24.630583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:24.632011 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:24.647109 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:24.647628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:24.648587 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:24.648975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:24.649438 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:24.649896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:24.697461 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:24.700420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:24.721615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:24.723748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:24.724467 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:24.730148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:24.730960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:24.732410 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:25.013446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:25.026391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5f97cf9a-7d7a-4f20-83e6-0b146fad2f38 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1554 microversion: 2.1 time: 0.403143 Aug 24 17:27:25.027951 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 107/231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:24 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1554 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:25.074456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:25.085306 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-22396623-e796-489a-b99f-d95598f13e82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.397349 Aug 24 17:27:25.085890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 125/232] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:24 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:26.057324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:26.058674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:26.072291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:26.074190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:26.075297 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:26.077117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:26.078200 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:26.079321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:26.132273 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:26.132273 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:26.183680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:26.183680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:26.183680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:26.186566 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:26.187438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:26.188197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:26.304626 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:26.326068 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5ff6109f-3b76-4827-898d-f4718e0192af tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1512 microversion: 2.1 time: 0.274697 Aug 24 17:27:26.328025 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 108/233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:26 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:26.342581 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-437689b4-713e-4d69-a79f-6acb70f5e34e req-f506d664-e89e-42dd-8e87-616b45b230a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13b16c2-1e23-4a41-a74b-59285423fa33", "name": "network-vif-deleted", "tag": "2e20a5cb-0c9d-45bd-991a-3253d8aa610d"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:27:26.386661 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-437689b4-713e-4d69-a79f-6acb70f5e34e req-f506d664-e89e-42dd-8e87-616b45b230a7 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:26.393035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-437689b4-713e-4d69-a79f-6acb70f5e34e req-f506d664-e89e-42dd-8e87-616b45b230a7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:26.394558 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-437689b4-713e-4d69-a79f-6acb70f5e34e req-f506d664-e89e-42dd-8e87-616b45b230a7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:26.499029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:26.514866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-7aeac422-14f7-445e-a876-48e86e79dc15 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.406390 Aug 24 17:27:26.516925 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 126/234] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:26 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:26.659272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-437689b4-713e-4d69-a79f-6acb70f5e34e req-f506d664-e89e-42dd-8e87-616b45b230a7 service nova] Creating event network-vif-deleted:2e20a5cb-0c9d-45bd-991a-3253d8aa610d for instance d13b16c2-1e23-4a41-a74b-59285423fa33 on hv-cinder-85164 Aug 24 17:27:26.672086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-437689b4-713e-4d69-a79f-6acb70f5e34e req-f506d664-e89e-42dd-8e87-616b45b230a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340214 Aug 24 17:27:26.673146 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 109/235] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:27:27.368303 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:27.369950 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:27.383531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:27.385635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:27.386626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:27.388087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:27.389056 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:27.390191 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:27.566135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:27.566135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b4ac69af-dfdb-4768-b7fc-9635e492b032 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1345 microversion: 2.1 time: 0.159357 Aug 24 17:27:27.566135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 127/236] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:27 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:27.567331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:27.567331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:27.567331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:27.567331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:27.568430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:27.568430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:27.568430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:27.569176 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:27.776364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:27.785071 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-25c4e259-daec-4022-9d4f-4dd1b07bd930 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.235514 Aug 24 17:27:27.785665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 110/237] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:27 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:28.557145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:28.559517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:28.573456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:28.574498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:28.575495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:28.576415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:28.576951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:28.577623 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:28.672386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:28.686563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8f5b1f24-eb1b-48f1-b633-113ba3769df6 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1345 microversion: 2.1 time: 0.134635 Aug 24 17:27:28.690413 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 128/238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:28 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:28.805923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:28.807901 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:28.819212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:28.819212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:28.819212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:28.819212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:28.819579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:28.819579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:29.074683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:29.099088 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5eee37f-578f-45e4-a7d5-3b00b8bc6903 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.296453 Aug 24 17:27:29.120787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 111/239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:28 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:29.717637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:29.722998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:29.726690 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:29.730302 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:29.730982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:29.731796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:29.740683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:29.741517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:29.910342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:29.927561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2265d61f-f9a7-426b-af38-47e55b566290 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1345 microversion: 2.1 time: 0.213861 Aug 24 17:27:29.929129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 129/240] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:29 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:30.150351 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:30.153013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:30.172793 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:30.174854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:30.177227 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:30.178374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:30.180316 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:30.180811 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:30.217774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:30.467068 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:30.486003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ddf86aa-9a9e-4648-a7b7-27d21e9a947a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.349448 Aug 24 17:27:30.487013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 112/241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:30 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:30.952287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:30.953505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:30.961214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:30.962681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:30.963599 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:30.964883 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:30.965713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:30.966483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:31.130168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:31.171805 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-570c6750-aa47-4f09-935a-f1ad33a284a8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1345 microversion: 2.1 time: 0.225264 Aug 24 17:27:31.187455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 130/242] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:30 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1345 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:31.513648 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:31.518579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:31.531839 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:31.532716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:31.533323 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:31.534216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:31.535018 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:31.536030 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:31.812971 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:31.831560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a1bcf437-24da-4451-aed0-c1153d4edb1f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.323876 Aug 24 17:27:31.831877 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 113/243] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:31 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:32.199799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:32.200688 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:32.211135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:32.212362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:32.213292 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:32.215061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:32.216194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:32.217140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:32.428281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:32.456850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bd8fe696-5483-4ea0-982c-13aae1b031b8 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1345 microversion: 2.1 time: 0.264059 Aug 24 17:27:32.459136 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 131/244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:32 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1345 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:32.858969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:32.860230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:32.866248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:32.866737 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:32.867204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:32.867954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:32.868408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:32.868887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:33.047998 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:33.061922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-759ca81f-2277-4b6c-b8f1-f95e29fedeae tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.207675 Aug 24 17:27:33.063399 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 114/245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:32 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:33.486826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:33.493810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:33.496150 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:33.496960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:33.497402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:33.499132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:33.499132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:33.500092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:33.559428 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:33.560072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:33.560685 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:33.561696 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lazy-loading 'fault' on Instance uuid d13b16c2-1e23-4a41-a74b-59285423fa33 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:27:33.623443 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2bc3ba87a549018d50fe3c9c6720d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879c5673d2cf49f5973d1faa5f774c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:33.643678 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b7bbf711-c3ea-4a30-9f47-ad23e02e5778 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 200 len: 1350 microversion: 2.1 time: 0.162267 Aug 24 17:27:33.644617 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 132/246] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:33 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 1350 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:34.094721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:34.095708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:34.102718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:34.103781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:34.104323 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:34.105044 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:34.105532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:34.106099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:34.351886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:34.360589 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9a3a2f8f-8e44-49a8-a0e3-f0140dfe9a57 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.272250 Aug 24 17:27:34.365442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 115/247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:34 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:34.670128 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:34.671688 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:34.685090 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:34.685846 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:34.687958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:34.688135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:34.688610 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:34.689039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:34.717300 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] HTTP exception thrown: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Request method failure captured: Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 HTTP/1.1 Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8lX_Zc6cSOlBLtJRYO7i2dtRCeJrvph_K-oyCLb0zyDRm9u5kB6p-a7XMTSW9AVRN-IvHk06pDkiZqhjskBsZf5pDYCBX44PqXAf7Tn7xCB3TcMDmHcGcMugvHvnab8CrypQUdDIFD0NQMWwhxhssDDV3-tKx3gp3SnX_J_SdErhk Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 879c5673d2cf49f5973d1faa5f774c43 Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:27:34.724435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_879c5673d2cf49f5973d1faa5f774c43", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 879c5673d2cf49f5973d1faa5f774c43 Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-DeleteServersTestJSON-1213426549-project Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: bb2bc3ba87a549018d50fe3c9c6720d0 Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-DeleteServersTestJSON-1213426549-project Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.725859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': 'd13b16c2-1e23-4a41-a74b-59285423fa33'} Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:27:34.726640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.727828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.729440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Returning 404 to user: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:27:34.729440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-682c48ee-a992-4ce2-8cf9-abbcbd851a28 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 404 len: 111 microversion: 2.1 time: 0.062520 Aug 24 17:27:34.729440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 133/248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:34 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:27:34.820053 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1802246611", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "networks": [{"uuid": "7a7d5ea0-066a-4544-8771-fa3d77dc391a"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:27:34.877490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:34.880801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:34.889258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:34.889761 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:34.890214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:34.891181 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:34.892176 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:34.892362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:34.905411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] validate_networks() for [('7a7d5ea0-066a-4544-8771-fa3d77dc391a', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:27:34.907510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] HTTP exception thrown: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Request method failure captured: Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33/os-volume_attachments HTTP/1.1 Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8lX_Zc6cSOlBLtJRYO7i2dtRCeJrvph_K-oyCLb0zyDRm9u5kB6p-a7XMTSW9AVRN-IvHk06pDkiZqhjskBsZf5pDYCBX44PqXAf7Tn7xCB3TcMDmHcGcMugvHvnab8CrypQUdDIFD0NQMWwhxhssDDV3-tKx3gp3SnX_J_SdErhk Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 879c5673d2cf49f5973d1faa5f774c43 Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:27:34.912108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_879c5673d2cf49f5973d1faa5f774c43", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 879c5673d2cf49f5973d1faa5f774c43 Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-DeleteServersTestJSON-1213426549-project Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: bb2bc3ba87a549018d50fe3c9c6720d0 Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-DeleteServersTestJSON-1213426549-project Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.913326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'server_id': 'd13b16c2-1e23-4a41-a74b-59285423fa33'} Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:27:34.914111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:34.915558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:27:34.917002 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Returning 404 to user: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:27:34.917002 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ea5871b3-08c6-42da-ad87-bad57bfff6ef tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041650 Aug 24 17:27:34.917002 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 134/249] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:27:34 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:27:35.382355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:35.383264 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:35.391334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:35.392458 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:35.392996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:35.393787 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:35.394926 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:35.395712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:35.551461 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:27:35.552715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:27:35.553625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:27:35.554320 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:27:35.555180 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:27:35.579317 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:35.579895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:35.580528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:35.581552 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:35.582253 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:35.582844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:35.618046 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Getting quotas for project cc0fed6b580c40509ff6514dcd82f4dd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:27:35.626537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Getting quotas for user 64eaec18a9d94723b541497bb5e1c105 and project cc0fed6b580c40509ff6514dcd82f4dd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:27:35.666624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:35.666945 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:27:35.670508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:27:35.672740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:35.675313 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-865d514d-9c40-4f77-925a-85a9c613fd69 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.297233 Aug 24 17:27:35.688648 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 135/250] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:35 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:35.970674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0afbc4a6-378f-4f94-af22-6f3acaf4c073 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.156297 Aug 24 17:27:35.971457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 116/251] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:27:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:27:35.994843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2f07a8f5-480a-48ba-8d62-45cc20354101 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:35.994843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2f07a8f5-480a-48ba-8d62-45cc20354101 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:36.116391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2f07a8f5-480a-48ba-8d62-45cc20354101 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:36.127137 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2f07a8f5-480a-48ba-8d62-45cc20354101 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1214 microversion: 2.1 time: 0.147743 Aug 24 17:27:36.128545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 136/252] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:35 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:36.620761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:36.621991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:36.634770 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:36.635294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:36.635944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:36.636924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:36.637545 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:36.642982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:36.679585 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] HTTP exception thrown: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Request method failure captured: Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 HTTP/1.1 Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8lX_Zc6cSOlBLtJRYO7i2dtRCeJrvph_K-oyCLb0zyDRm9u5kB6p-a7XMTSW9AVRN-IvHk06pDkiZqhjskBsZf5pDYCBX44PqXAf7Tn7xCB3TcMDmHcGcMugvHvnab8CrypQUdDIFD0NQMWwhxhssDDV3-tKx3gp3SnX_J_SdErhk Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 879c5673d2cf49f5973d1faa5f774c43 Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:27:36.693197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_879c5673d2cf49f5973d1faa5f774c43", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 879c5673d2cf49f5973d1faa5f774c43 Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-1213426549-project Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: bb2bc3ba87a549018d50fe3c9c6720d0 Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-1213426549-project Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.696526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'd13b16c2-1e23-4a41-a74b-59285423fa33'} Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:27:36.699242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.701771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.707614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Returning 404 to user: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:27:36.707614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5328bb16-763a-4bc0-8e86-21f8deac3dcf tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 404 len: 111 microversion: 2.1 time: 0.086885 Aug 24 17:27:36.707614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 117/253] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:27:36 2022] DELETE /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:27:36.719505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:36.721853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:36.729377 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:36.729377 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] [instance: d13b16c2-1e23-4a41-a74b-59285423fa33] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:36.736675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:36.737497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:36.738218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:36.740016 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:36.741338 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:36.742331 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:36.744445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:36.745585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:36.746086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:36.746991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:36.747684 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:36.748240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:36.804840 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] HTTP exception thrown: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Request method failure captured: Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 HTTP/1.1 Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8lX_Zc6cSOlBLtJRYO7i2dtRCeJrvph_K-oyCLb0zyDRm9u5kB6p-a7XMTSW9AVRN-IvHk06pDkiZqhjskBsZf5pDYCBX44PqXAf7Tn7xCB3TcMDmHcGcMugvHvnab8CrypQUdDIFD0NQMWwhxhssDDV3-tKx3gp3SnX_J_SdErhk Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 879c5673d2cf49f5973d1faa5f774c43 Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:27:36.808289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_879c5673d2cf49f5973d1faa5f774c43", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/879c5673d2cf49f5973d1faa5f774c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 879c5673d2cf49f5973d1faa5f774c43 Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-DeleteServersTestJSON-1213426549 Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-DeleteServersTestJSON-1213426549-project Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: bb2bc3ba87a549018d50fe3c9c6720d0 Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-DeleteServersTestJSON-1213426549-project Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.811079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'd13b16c2-1e23-4a41-a74b-59285423fa33'} Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:27:36.812735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. Aug 24 17:27:36.815492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:27:36.818117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] Returning 404 to user: Instance d13b16c2-1e23-4a41-a74b-59285423fa33 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:27:36.818117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-13cd98cd-8c5b-4a32-8417-ed6ca3e697d9 tempest-DeleteServersTestJSON-1213426549 tempest-DeleteServersTestJSON-1213426549-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33" status: 404 len: 111 microversion: 2.1 time: 0.098657 Aug 24 17:27:36.820639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 118/254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:36 2022] GET /compute/v2.1/servers/d13b16c2-1e23-4a41-a74b-59285423fa33 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:27:37.164416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a2885bc-f802-4417-9f53-438388c7aa4e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:37.175332 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a2885bc-f802-4417-9f53-438388c7aa4e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:37.437512 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1a2885bc-f802-4417-9f53-438388c7aa4e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:37.463574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a2885bc-f802-4417-9f53-438388c7aa4e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1214 microversion: 2.1 time: 0.312842 Aug 24 17:27:37.493004 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 119/255] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:37 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1214 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:37.633689 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:37.666155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-41fad953-5c09-49ca-9fc4-516f7627e4a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.956591 Aug 24 17:27:37.666730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 137/256] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:36 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:38.485518 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:38.487115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:38.495308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:38.496050 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:38.496898 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:38.497809 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:38.498428 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:38.499057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:38.603705 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:38.630216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d1c51260-4438-4d4a-a718-0eae0fb59509 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1218 microversion: 2.1 time: 0.148267 Aug 24 17:27:38.631171 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 120/257] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:38 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:38.701593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:38.703268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:38.716749 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:38.717524 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:38.718268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:38.719593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:38.720694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:38.721715 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:39.029942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:39.045709 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8a24cf0b-0c83-4957-8fa9-290363d3f782 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.348252 Aug 24 17:27:39.049363 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 138/258] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:38 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:39.664639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:39.673416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:39.685715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:39.686606 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:39.687254 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:39.688400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:39.689060 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:39.690988 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:40.017197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:40.038580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-27b0eff9-05a1-45d1-b72e-3c4221e826e6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1266 microversion: 2.1 time: 0.381213 Aug 24 17:27:40.041905 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 121/259] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:39 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1266 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:40.076584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:40.077693 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:40.106587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:40.107501 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:40.108292 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:40.109450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:40.110534 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:40.111598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:40.549220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:40.564847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c2d524ca-4667-4bf4-a8b4-b1817a125557 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.494193 Aug 24 17:27:40.572113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 139/260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:40 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:41.083582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:41.089555 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:41.105514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:41.106664 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:41.107517 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:41.108883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:41.110135 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:41.110837 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:41.286040 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:41.301540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3e9ac1d-d484-4071-92a6-39cf4405fd9c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1272 microversion: 2.1 time: 0.221709 Aug 24 17:27:41.303917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 122/261] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:41 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:41.598323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:41.601325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:41.635879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:41.642288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:41.643323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:41.644544 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:41.645180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:41.645830 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:41.968472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:41.981598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e65367db-c25a-4065-ba62-d00ddd8f2b7c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.391837 Aug 24 17:27:41.982207 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 140/262] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:41 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:42.334533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:42.335359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:42.346371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:42.346880 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:42.347374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:42.348132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:42.349782 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:42.350410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:42.730800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:42.747314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5079d80-4c71-4668-beda-9fe960f6066b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.425936 Aug 24 17:27:42.749125 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 123/263] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:42 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:43.007793 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:43.008769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:43.020836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:43.021407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:43.023018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:43.023830 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:43.024346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:43.025742 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:43.347589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:43.356297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-7748dbcc-a6be-45c0-9bf4-fcc4b4db6cec tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.352220 Aug 24 17:27:43.374579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 141/264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:43 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:43.801965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:43.815411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:43.830058 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:43.830558 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:43.831210 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:43.831844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:43.832300 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:43.835082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:44.011314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:44.032206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cd211e05-190f-4aa8-9045-1ca5230bc142 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.265235 Aug 24 17:27:44.035027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 124/265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:43 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:44.385687 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:44.385687 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:44.392446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:44.404573 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:44.406296 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:44.407210 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:44.408921 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:44.410147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:44.425352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:44.601381 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-09449fb0-8a66-41ab-9ef0-43aa4c83f689 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Action: 'create', calling method: .version_select at 0x7f3f30803790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-898876491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFCI47rbpjBc5lpAFvtHHiQcQLkNR9CQT6zgqEnoD7ForxBZozX88APqvzgYZIG5D77Oe8WobeyH2OiQb7qqZHPilye7IPHa6zsm+P9Q1kzYtPvqa59bwxnvuiL0y+COg=="}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:27:44.636571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-09449fb0-8a66-41ab-9ef0-43aa4c83f689 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Getting quotas for project 036fc4bf065249e29d0e1e90d23bae19. Resources: {'key_pairs'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:27:44.641908 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-09449fb0-8a66-41ab-9ef0-43aa4c83f689 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Getting quotas for user 47da700d7d0f4d5cb1ea984a82d643bf and project 036fc4bf065249e29d0e1e90d23bae19. Resources: {'key_pairs'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:27:44.852874 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-09449fb0-8a66-41ab-9ef0-43aa4c83f689 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.575372 Aug 24 17:27:44.856895 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 142/266] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:27:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:27:44.870221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-7a341684-e00f-4f6f-adc4-486f2406c1d1 req-045fc3ea-7cd3-4559-9d99-2f5387137840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7dca741-12f7-477e-b637-a96d513498ca", "tag": "08fa155a-4eff-46a6-aa50-676584997ba7"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:27:44.896366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:44.909415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-7a341684-e00f-4f6f-adc4-486f2406c1d1 req-045fc3ea-7cd3-4559-9d99-2f5387137840 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:44.912291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c4498a62-eea7-4a0f-9853-128b127e8d60 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.537964 Aug 24 17:27:44.924016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 125/267] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:44 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:44.944963 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-7a341684-e00f-4f6f-adc4-486f2406c1d1 req-045fc3ea-7cd3-4559-9d99-2f5387137840 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:44.945831 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-7a341684-e00f-4f6f-adc4-486f2406c1d1 req-045fc3ea-7cd3-4559-9d99-2f5387137840 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:44.986517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-7a341684-e00f-4f6f-adc4-486f2406c1d1 req-045fc3ea-7cd3-4559-9d99-2f5387137840 service nova] Creating event network-changed:08fa155a-4eff-46a6-aa50-676584997ba7 for instance d7dca741-12f7-477e-b637-a96d513498ca on hv-cinder-85164 Aug 24 17:27:44.998039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-7a341684-e00f-4f6f-adc4-486f2406c1d1 req-045fc3ea-7cd3-4559-9d99-2f5387137840 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141319 Aug 24 17:27:45.000668 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 143/268] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:27:45.059508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:45.060809 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:45.077390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:45.080360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:45.083597 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:45.085581 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:45.091556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:45.092720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:45.519169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:45.532394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-004f5528-6aaf-4b81-a2c2-7ec1935847c4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.482007 Aug 24 17:27:45.535879 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 126/269] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:45 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:45.948336 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:45.949820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:45.965851 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:45.965851 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:45.965851 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:45.965851 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:45.966240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:45.966240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:46.182022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:46.190031 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ab5e8ca3-1ff9-4d72-b35c-bc78ad003c3f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.248003 Aug 24 17:27:46.190650 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 144/270] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:45 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:46.572018 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:46.574309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:46.581080 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:46.583354 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:46.584340 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:46.584989 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:46.585842 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:46.586438 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:46.587301 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:46.790548 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:46.809928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09c0b39e-fa89-4cdc-b75f-cffc36f5d3f3 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.242488 Aug 24 17:27:46.820944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 127/271] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:46 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:27:47.211906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:47.213052 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:47.217393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:47.229269 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:47.229269 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:47.229531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:47.231020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:47.231514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:47.231948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:47.427741 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:47.440924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-afcc23ac-d0ef-4c0a-9c0d-a7ca3694a863 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.234274 Aug 24 17:27:47.441506 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 145/272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:47 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:47.830824 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:47.831487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:47.833885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:47.839381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:47.839882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:47.840327 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:47.841095 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:47.841498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:47.841923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:48.080053 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:48.089370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-24790df6-15a5-4e18-b195-3475cb3d6ec6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.262411 Aug 24 17:27:48.090217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 128/273] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:47 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:48.469609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:48.470513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:48.477310 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:48.478104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:48.478479 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:48.479226 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:48.479674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:48.480186 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:48.674517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:48.684247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-81d3157f-cc4e-40c5-a351-71474ce5a749 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.218501 Aug 24 17:27:48.684861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 146/274] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:48 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:49.115737 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:49.116492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:49.156783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:49.157532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:49.158219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:49.159453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:49.160222 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:49.160967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:49.364857 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:49.375230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6f0b228-d18c-43b6-a9c2-3e0fae83cd5f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.265950 Aug 24 17:27:49.376399 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 129/275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:49 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:49.706414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:49.707057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:49.713717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:49.714201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:49.714692 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:49.715599 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:49.719586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:49.719586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:49.907809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:49.924845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e5451e36-be26-4ec5-b314-fe873d3dfb0b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.220942 Aug 24 17:27:49.939497 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 147/276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:49 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:50.398975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:50.400873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:50.439906 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:50.441440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:50.442319 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:50.443627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:50.444499 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:50.445605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:50.628550 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:50.637596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03b0abdb-592a-4b3b-b2b7-54f0dc366aff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.244041 Aug 24 17:27:50.638272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 130/277] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:50 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:50.954562 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:50.955584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:50.966152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:50.967066 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:50.967748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:50.968986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:50.969817 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:50.970609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:51.162158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:51.172587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4c604307-a672-4f35-8536-ced2f3a91024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.225341 Aug 24 17:27:51.173471 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 148/278] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:50 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:51.661434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:51.662052 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:51.670120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:51.686695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:51.686695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:51.686695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:51.686695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:51.687104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:51.925226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:51.941589 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78c92d91-0b76-4239-804d-0c7aa9c0d023 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.283704 Aug 24 17:27:51.942974 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 131/279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:51 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:52.195104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:52.195939 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:52.205026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:52.205555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:52.206098 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:52.206936 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:52.207508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:52.208043 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:52.489606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:52.504732 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6423091b-ddf9-434b-bfd5-038204706081 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.313770 Aug 24 17:27:52.506886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 149/280] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:52 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:52.973718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:52.974346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:52.981746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:52.982235 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:52.982674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:52.983476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:52.983927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:52.984550 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:52.988700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:53.154885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:53.166203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef5b4e22-cd7a-46de-92a5-3683da3c9cdf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.195387 Aug 24 17:27:53.167480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 132/281] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:52 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:53.532385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:53.533439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:53.544384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:53.545462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:53.546365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:53.547638 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:53.548143 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:53.548794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:53.770417 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:53.780061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fab50325-d577-44bf-82cc-f1f9cf371047 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.253628 Aug 24 17:27:53.783336 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 150/282] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:53 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:54.188253 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:54.188867 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:54.206294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:54.207047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:54.207841 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:54.209031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:54.209807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:54.210522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:54.399245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:54.414479 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec3b16a0-805e-4ca7-a6fe-be33f87a5c70 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.229182 Aug 24 17:27:54.419213 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 133/283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:54 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:54.807040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:54.808010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:54.811203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=6 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:54.818824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:54.819481 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:54.820253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:54.822253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:54.823099 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:54.823854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:55.057397 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8ca7698f-174e-4c81-a022-e105af6ae95d req-e710c891-5715-44f3-af76-fa0553295519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dca741-12f7-477e-b637-a96d513498ca", "name": "network-vif-plugged", "status": "completed", "tag": "08fa155a-4eff-46a6-aa50-676584997ba7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:27:55.081511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8ca7698f-174e-4c81-a022-e105af6ae95d req-e710c891-5715-44f3-af76-fa0553295519 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:55.082218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8ca7698f-174e-4c81-a022-e105af6ae95d req-e710c891-5715-44f3-af76-fa0553295519 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:55.083287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8ca7698f-174e-4c81-a022-e105af6ae95d req-e710c891-5715-44f3-af76-fa0553295519 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:55.098224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:55.114116 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8ca7698f-174e-4c81-a022-e105af6ae95d req-e710c891-5715-44f3-af76-fa0553295519 service nova] Creating event network-vif-plugged:08fa155a-4eff-46a6-aa50-676584997ba7 for instance d7dca741-12f7-477e-b637-a96d513498ca on hv-cinder-85164 Aug 24 17:27:55.117326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ac38852a-52ba-4c6d-88e9-95d5c4f66620 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1522 microversion: 2.1 time: 0.316778 Aug 24 17:27:55.128262 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8ca7698f-174e-4c81-a022-e105af6ae95d req-e710c891-5715-44f3-af76-fa0553295519 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081795 Aug 24 17:27:55.128866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 151/284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:54 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:55.129054 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 134/285] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:27:55.449721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:55.450437 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:55.459683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:55.460882 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:55.461807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:55.463776 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:55.464892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:55.465672 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:55.688827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:55.688827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ee439594-f507-4273-9f80-310327f0c388 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.240665 Aug 24 17:27:55.688827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 152/286] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:55 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:56.150520 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:56.152001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:56.158891 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:56.159407 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:56.159841 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:56.160557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:56.161003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:56.161421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:56.369872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:56.384088 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3617b22b-059e-4ebd-a557-bbd2c7a296d1 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1502 microversion: 2.1 time: 0.242389 Aug 24 17:27:56.385245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 135/287] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:56 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:56.411720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:56.412466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:56.420067 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:56.420838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:56.420838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:56.421716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:56.422177 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:56.422609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:56.681062 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:56.691847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8a26e78a-a328-4579-88c2-74479edb84fc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1514 microversion: 2.1 time: 0.286028 Aug 24 17:27:56.692571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 153/288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:56 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:56.748713 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:56.748713 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:56.756384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:56.757252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:56.759283 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:56.760785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:56.762058 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:56.763892 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:57.029258 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:57.044992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b35a0f6-911c-42f2-ba12-7da12476545a tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.323746 Aug 24 17:27:57.046319 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 136/289] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:56 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:58.079094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:58.079557 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:58.085756 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:58.086386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:58.086701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:58.088001 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:58.088465 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:58.088887 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:58.233537 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:58.241695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b3d8cb8f-4a4f-4695-8baf-733ccd28e9d1 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.166682 Aug 24 17:27:58.242325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 154/290] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:58 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:59.267586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:27:59.268440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:59.280655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:59.280655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:59.280655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:59.280655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:59.281173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:59.281173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:59.515558 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:27:59.533217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6e2ee97-ea79-4bb8-87f1-7960c0097a44 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1314 microversion: 2.1 time: 0.270577 Aug 24 17:27:59.534067 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 137/291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:27:59 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:27:59.968285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:27:59.971669 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:27:59.978442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:59.996352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:59.996352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:59.996352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:27:59.996352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:27:59.996916 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:27:59.996916 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:00.015674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lazy-loading 'flavor' on Instance uuid 509a6e8e-d774-492b-9618-7de5caf2955f {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:28:00.514676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bf080802-d383-4862-86de-37a78a191f9a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f/action" status: 200 len: 32 microversion: 2.1 time: 0.550085 Aug 24 17:28:00.516102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 155/292] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:27:59 2022] POST /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:28:00.529551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:00.531005 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:00.545023 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:00.545559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:00.546005 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:00.546787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:00.547356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:00.547788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:00.563855 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:00.564576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:00.573812 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:00.574316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:00.574759 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:00.575508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:00.575967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:00.576441 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:00.830025 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:00.840840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:00.844408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9ffe25b4-3f90-4c46-a761-ea6904df63b8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.321195 Aug 24 17:28:00.845229 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 138/293] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:00 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:00.852828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e723d2ce-853a-41c2-abec-43fc84e39669 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1498 microversion: 2.1 time: 0.293129 Aug 24 17:28:00.853771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 156/294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:00 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1498 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:01.866245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:01.867139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:01.876239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:01.876673 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:01.877120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:01.877843 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:01.878380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:01.879116 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:02.036536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:02.044674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-45489339-381d-4ca6-a89d-ac7a69196d5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.182646 Aug 24 17:28:02.045268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 139/295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:01 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:03.066668 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:03.067365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:03.073747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:03.074230 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:03.074681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:03.075403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:03.075870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:03.076274 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:03.238704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:03.251706 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-887dde13-5c38-403f-81f0-ed00697f49e7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.188802 Aug 24 17:28:03.252609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 157/296] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:03 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:03.426339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:03.426942 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:03.433942 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:03.434493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:03.434958 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:03.435726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:03.436843 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:03.438469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:03.484868 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:28:04.024625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f05cfc32-24ce-469d-a68f-1f8b9e9be597 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 204 len: 0 microversion: 2.1 time: 0.604108 Aug 24 17:28:04.026962 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 140/297] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:28:03 2022] DELETE /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:28:04.040791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:04.041472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:04.049698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:04.050554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:04.051705 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:04.053199 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:04.056488 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:04.057277 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:04.260143 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:04.273050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c4ae5231-2858-4714-844d-a9c33c375bda tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1504 microversion: 2.1 time: 0.240264 Aug 24 17:28:04.274036 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 158/298] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:04 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:04.282728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:04.284047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:04.292543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:04.293133 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:04.293556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:04.294286 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:04.294734 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:04.295189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:04.481448 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:04.491412 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f35f7b88-79bd-416d-9854-1c05a70e9cfb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.219729 Aug 24 17:28:04.496247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 141/299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:04 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:05.299662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:05.300521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:05.306917 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:05.307665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:05.308183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:05.309460 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:05.310236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:05.310936 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:05.480868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:05.491753 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a136d36b-cc54-4291-9255-95e41da90c5d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1504 microversion: 2.1 time: 0.196039 Aug 24 17:28:05.492482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 159/300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:05 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:05.514926 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:05.515678 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:05.523066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:05.523565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:05.524549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:05.525259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:05.525719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:05.526162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:05.675374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:05.684805 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e2537401-1b6a-4d4c-b09f-d0b738d5874c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.173426 Aug 24 17:28:05.685531 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 142/301] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:05 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:06.518097 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:06.518097 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:06.526084 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:06.526584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:06.527110 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:06.527823 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:06.528281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:06.528713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:06.703523 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:06.706085 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:06.710040 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:06.713324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:06.713876 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-762e0483-0721-4a15-bc8e-52341deb798d tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1504 microversion: 2.1 time: 0.200841 Aug 24 17:28:06.714002 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:06.714432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:06.714547 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 160/302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:06 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:06.715278 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:06.715793 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:06.716279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:06.880594 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:06.889157 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-10a1a341-8abd-4c34-b486-e5e840d26b01 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.186945 Aug 24 17:28:06.889770 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 143/303] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:06 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:07.734194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:07.734784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:07.740903 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:07.741377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:07.741817 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:07.742472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:07.742938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:07.743362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:07.895436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:07.903718 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2edab10c-d2bd-4f11-8a1a-cb7176744525 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1504 microversion: 2.1 time: 0.173264 Aug 24 17:28:07.905730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 161/304] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:07 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:07.910866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:07.911651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:07.918519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:07.919043 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:07.919519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:07.920204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:07.920828 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:07.921253 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:08.065532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:08.079559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2215dd92-88d0-4b68-9b1a-17a1ea1b4aea tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.173136 Aug 24 17:28:08.080617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 144/305] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:07 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:08.926795 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:08.927545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:08.937249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:08.937249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:08.937249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:08.937249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:08.937951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:08.937951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:09.094408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:09.101326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:09.103124 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:09.109279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:09.109776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:09.109942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-16af3610-e63a-4d7d-99cf-6ff1c1737dbe tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1504 microversion: 2.1 time: 0.186718 Aug 24 17:28:09.110220 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:09.110845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 162/306] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:08 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:09.111047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:09.111402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:09.111835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:09.256098 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:09.267637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-508dae58-acb7-481b-8d24-6d5efffcc6d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.167021 Aug 24 17:28:09.267637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 145/307] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:09 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:10.140624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:10.141392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:10.149914 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:10.150399 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:10.150833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:10.151563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:10.152279 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:10.153047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:10.286557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:10.287199 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:10.294632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:10.295359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:10.295807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:10.296516 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:10.296972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:10.297326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:10.297527 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:10.306184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-904bbb0c-58c2-4881-a3f6-a03215880956 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1504 microversion: 2.1 time: 0.171053 Aug 24 17:28:10.306765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 163/308] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:10 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:10.436554 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:10.444378 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6a304e55-f86a-4211-976e-86214f16a26f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.161717 Aug 24 17:28:10.444958 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 146/309] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:10 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:11.332118 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:11.337594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:11.344800 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:11.345298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:11.345740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:11.346531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:11.346930 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:11.347349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:11.467967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:11.468980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:11.481419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:11.482230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:11.482555 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:11.483492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:11.484013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:11.484631 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:11.513902 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:11.528212 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-def0e6e5-5818-4acd-af06-ffb8c18cfa04 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1504 microversion: 2.1 time: 0.202515 Aug 24 17:28:11.528887 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 164/310] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:11 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:11.626694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:11.629102 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:11.635262 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c1a634f-8b34-40c7-87cc-f522604adc68 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.172519 Aug 24 17:28:11.640952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 147/311] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:11 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:12.553881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:12.554882 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:12.565267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:12.565983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:12.566474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:12.567203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:12.567654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:12.568074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:12.659028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:12.659732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:12.667642 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:12.668549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:12.669017 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:12.669803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:12.670275 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:12.670726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:12.771162 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:12.783447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-eddfe5ca-6448-48cb-b48f-f6bde5735568 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1504 microversion: 2.1 time: 0.236482 Aug 24 17:28:12.784398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 165/312] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:12 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:12.850394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:12.858753 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5b2afee-9f03-41d2-bc70-cd2c00dc3b61 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.206126 Aug 24 17:28:12.859369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 148/313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:12 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:13.249487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1584072806", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:13.303443 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] validate_networks() for None {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:28:13.807065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:13.808362 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:13.815513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:13.816008 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:13.816480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:13.817158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:13.817616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:13.818044 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:14.064201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:28:14.071552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:28:14.071552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:28:14.071552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:28:14.071552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:28:14.078579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:14.079114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:14.079555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:14.080281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:14.080741 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:14.081165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:14.104180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Getting quotas for project de1ad2d3babc4f32af3f30a3dda9dd48. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:28:14.112965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Getting quotas for user e40c080ddcf34210bcf1a75215ee1e43 and project de1ad2d3babc4f32af3f30a3dda9dd48. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:28:14.128525 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:28:14.130938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:28:14.182473 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:14.194476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-120a0a6b-d495-4bd6-851c-afd6d7a3a008 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1504 microversion: 2.1 time: 0.391767 Aug 24 17:28:14.195357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 149/314] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:13 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:14.204298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:14.205722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:14.222128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:14.226312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:14.226312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:14.226312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:14.226312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:14.227541 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:14.284457 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2c16615e-dc7e-4bca-b159-5d2669e77c12 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037358 Aug 24 17:28:14.297688 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 166/315] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:28:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:28:14.317490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-7ba33f37-3e57-4aaa-aaa1-5c72c6d66782 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:14.317490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-7ba33f37-3e57-4aaa-aaa1-5c72c6d66782 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:14.458743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-7ba33f37-3e57-4aaa-aaa1-5c72c6d66782 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:14.475990 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-7ba33f37-3e57-4aaa-aaa1-5c72c6d66782 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1215 microversion: 2.1 time: 0.175290 Aug 24 17:28:14.477506 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 167/316] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:14 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:14.605234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:14.614033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-518b5615-a754-497c-8b62-7cc575673f5d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.417021 Aug 24 17:28:14.614894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 150/317] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:14 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:14.919367 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-7cdb5e01-574f-4357-aceb-6933dd53f2c7 req-eaea5621-7e2e-48b1-a45f-dc1825c8c5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dca741-12f7-477e-b637-a96d513498ca", "name": "network-vif-deleted", "tag": "08fa155a-4eff-46a6-aa50-676584997ba7"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:14.931909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-7cdb5e01-574f-4357-aceb-6933dd53f2c7 req-eaea5621-7e2e-48b1-a45f-dc1825c8c5b1 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:14.936023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-7cdb5e01-574f-4357-aceb-6933dd53f2c7 req-eaea5621-7e2e-48b1-a45f-dc1825c8c5b1 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:14.936023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-7cdb5e01-574f-4357-aceb-6933dd53f2c7 req-eaea5621-7e2e-48b1-a45f-dc1825c8c5b1 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:14.944724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-7cdb5e01-574f-4357-aceb-6933dd53f2c7 req-eaea5621-7e2e-48b1-a45f-dc1825c8c5b1 service nova] Creating event network-vif-deleted:08fa155a-4eff-46a6-aa50-676584997ba7 for instance d7dca741-12f7-477e-b637-a96d513498ca on hv-cinder-85164 Aug 24 17:28:14.950562 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-7cdb5e01-574f-4357-aceb-6933dd53f2c7 req-eaea5621-7e2e-48b1-a45f-dc1825c8c5b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Aug 24 17:28:14.951381 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 168/318] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:28:15.230579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:15.231483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:15.237652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:15.238143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:15.238580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:15.239303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:15.239779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:15.240182 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:15.310656 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:15.322628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5bf22c2b-515d-45ef-93ee-21fdc0753458 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1299 microversion: 2.1 time: 0.096935 Aug 24 17:28:15.323700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 151/319] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:15 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:15.497599 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0125afa9-67f2-4fe7-a1f9-5a46cb1f0ff2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:15.498281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0125afa9-67f2-4fe7-a1f9-5a46cb1f0ff2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:15.571855 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0125afa9-67f2-4fe7-a1f9-5a46cb1f0ff2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:15.579644 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0125afa9-67f2-4fe7-a1f9-5a46cb1f0ff2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1215 microversion: 2.1 time: 0.086576 Aug 24 17:28:15.580227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 169/320] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:15 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:15.637603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:15.638261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:15.645952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:15.646657 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:15.647383 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:15.648547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:15.650279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:15.651073 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:15.835700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:15.844653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16432da5-b0bb-4c89-b933-0d02d8a474e9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.212400 Aug 24 17:28:15.845253 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 152/321] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:15 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:16.347818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:16.348429 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:16.355030 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:16.355527 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:16.355967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:16.356671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:16.357123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:16.357549 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:16.531769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:16.532498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:16.533269 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:16.533269 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lazy-loading 'fault' on Instance uuid d7dca741-12f7-477e-b637-a96d513498ca {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:28:16.579756 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:16.589038 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2d159ab3-2696-40bb-867c-179602545c77 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 200 len: 1304 microversion: 2.1 time: 0.245034 Aug 24 17:28:16.589724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 170/322] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:16 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:16.600449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:16.601883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:16.605588 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:16.609168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:16.609666 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:16.610107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:16.610818 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:16.611337 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:16.611761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:16.685302 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:16.693969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a47f74b-af08-4492-b974-75cd8c855da8 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1211 microversion: 2.1 time: 0.097531 Aug 24 17:28:16.694572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 153/323] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:16 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:16.874330 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:16.875486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:16.886034 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:16.887238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:16.887969 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:16.889073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:16.889832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:16.890553 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:17.059976 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:17.068873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cbf70ddc-da8d-4b03-9604-63c244f137cc tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.201172 Aug 24 17:28:17.069634 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 171/324] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:16 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:17.611610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:17.612269 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: d7dca741-12f7-477e-b637-a96d513498ca] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:17.620585 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:17.621081 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:17.621523 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:17.622241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:17.622706 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:17.623167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:17.638994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] HTTP exception thrown: Instance d7dca741-12f7-477e-b637-a96d513498ca could not be found. Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Request method failure captured: Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca HTTP/1.1 Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl-C5-R_Gy5cH2IaZ34Xcb5Sstch200AyTdFQ81sgpSKAICb58ZqBzN5YsYCRWwF1SKOjNAGPEVjde9z1lAzk57M111J8JMpmu3WCQTfYgm613nj-647bXdxeiY0YBC29Su3A98DDcaqqpNq89gT64kxAqAE7IAbwGEhD3gMloOs0gw Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: cc0fed6b580c40509ff6514dcd82f4dd Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesActionsTest-171377486 Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:28:17.640774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cc0fed6b580c40509ff6514dcd82f4dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cc0fed6b580c40509ff6514dcd82f4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cc0fed6b580c40509ff6514dcd82f4dd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cc0fed6b580c40509ff6514dcd82f4dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-VolumesActionsTest-171377486 Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: cc0fed6b580c40509ff6514dcd82f4dd Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesActionsTest-171377486 Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-VolumesActionsTest-171377486-project Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 64eaec18a9d94723b541497bb5e1c105 Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-VolumesActionsTest-171377486-project Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance d7dca741-12f7-477e-b637-a96d513498ca could not be found. Aug 24 17:28:17.643726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'd7dca741-12f7-477e-b637-a96d513498ca'} Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7dca741-12f7-477e-b637-a96d513498ca could not be found. Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:28:17.645464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7dca741-12f7-477e-b637-a96d513498ca could not be found. Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7dca741-12f7-477e-b637-a96d513498ca could not be found. Aug 24 17:28:17.651173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:28:17.653429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Returning 404 to user: Instance d7dca741-12f7-477e-b637-a96d513498ca could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:28:17.653429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed5d4be6-5ac1-4ae5-b59c-815c62193b16 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca" status: 404 len: 111 microversion: 2.1 time: 0.035231 Aug 24 17:28:17.653429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 154/325] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:17 2022] GET /compute/v2.1/servers/d7dca741-12f7-477e-b637-a96d513498ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:28:17.723902 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:17.724516 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:17.733207 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:17.733583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:17.734216 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:17.734973 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:17.735439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:17.735924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:17.800459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1350652649", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "networks": [{"uuid": "7a7d5ea0-066a-4544-8771-fa3d77dc391a"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:17.843898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:17.848812 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:17.861399 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-42181d42-fa57-43ee-8aec-5258db622136 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1267 microversion: 2.1 time: 0.145499 Aug 24 17:28:17.862217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 172/326] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:17 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:17.872819 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] validate_networks() for [('7a7d5ea0-066a-4544-8771-fa3d77dc391a', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:28:18.094285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:18.094995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:18.102757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:18.103487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:18.103932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:18.104834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:18.105293 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:18.105720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:18.501658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:18.513294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a7d38d53-cbaf-4c9b-971b-e9509207ba24 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.424368 Aug 24 17:28:18.514202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 173/327] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:18 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:18.583478 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:28:18.584065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:28:18.584905 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:28:18.585368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:28:18.585787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:28:18.597831 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:18.598567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:18.599185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:18.600065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:18.600434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:18.601006 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:18.633540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Getting quotas for project cc0fed6b580c40509ff6514dcd82f4dd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:28:18.640806 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Getting quotas for user 64eaec18a9d94723b541497bb5e1c105 and project cc0fed6b580c40509ff6514dcd82f4dd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:28:18.659879 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:28:18.664498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:28:18.867069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f4bbc686-0aa2-42bf-a251-137ae2e049ce tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070599 Aug 24 17:28:18.868101 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 155/328] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:28:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:28:18.881084 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-68a73624-6e40-4929-a3b0-c102c1acf886 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:18.881860 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-68a73624-6e40-4929-a3b0-c102c1acf886 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:18.887614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:18.888200 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:18.922812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:18.922812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:18.922812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:18.922812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:18.923371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:18.923371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:18.946212 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-68a73624-6e40-4929-a3b0-c102c1acf886 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:18.958010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-68a73624-6e40-4929-a3b0-c102c1acf886 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1214 microversion: 2.1 time: 0.082402 Aug 24 17:28:18.959328 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 174/329] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:18 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:19.023899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:19.023899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b2933ccd-de64-41d5-b185-973b6b7a4810 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1273 microversion: 2.1 time: 0.103527 Aug 24 17:28:19.023899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 156/330] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:18 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:19.540787 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:19.541420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:19.548109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:19.548797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:19.549030 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:19.549716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:19.550172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:19.550609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:19.759771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:19.772366 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4e15f738-b234-46ff-96ef-7dd78092c49f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.235940 Aug 24 17:28:19.773212 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 175/331] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:19 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:19.979520 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ce1d88ca-83ca-486c-87ca-2ed9ea4203d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:19.980246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ce1d88ca-83ca-486c-87ca-2ed9ea4203d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:20.008840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:20.009534 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:20.020220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:20.020220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:20.020220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:20.020220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:20.020712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:20.020712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:20.049751 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ce1d88ca-83ca-486c-87ca-2ed9ea4203d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:20.061381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ce1d88ca-83ca-486c-87ca-2ed9ea4203d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1214 microversion: 2.1 time: 0.085019 Aug 24 17:28:20.062325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 157/332] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:19 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:20.293276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:20.301111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ef19557c-393c-4fc5-b96e-042e7ad086ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.296727 Aug 24 17:28:20.301713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 176/333] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:20 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:20.809380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:20.810504 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:20.818024 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:20.818653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:20.819207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:20.819993 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:20.820573 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:20.821091 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:20.974802 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:20.986103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-654a770f-89c3-4d9c-8590-49b567f4ac0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.181628 Aug 24 17:28:20.987310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 158/334] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:20 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:21.085077 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:21.096343 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:21.096343 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:21.096343 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:21.096343 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:21.096343 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:21.096813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:21.096813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:21.096813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:21.165347 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:21.173029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-40c3b5be-f1db-4d3f-ac58-6ac71ffc5dc7 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1218 microversion: 2.1 time: 0.091772 Aug 24 17:28:21.173602 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 177/335] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:21 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:21.323551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:21.324153 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:21.330385 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:21.331268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:21.340761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:21.341759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:21.342538 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:21.343168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:21.515000 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:21.523630 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47510027-b082-4a6d-a1b1-52873cdb9b23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.204699 Aug 24 17:28:21.524964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 159/336] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:21 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:21.682266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-672fa22b-2a16-42e5-8a56-490b14f9cbcb req-a056a3eb-ff9c-451e-9651-9f8ae5911235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9783578-c61c-4c20-b25a-ffcd8257be4d", "tag": "f6189040-7c7d-458c-9e40-8de4fe6b4d3e"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:21.701648 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-672fa22b-2a16-42e5-8a56-490b14f9cbcb req-a056a3eb-ff9c-451e-9651-9f8ae5911235 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:21.702139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-672fa22b-2a16-42e5-8a56-490b14f9cbcb req-a056a3eb-ff9c-451e-9651-9f8ae5911235 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:21.702568 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-672fa22b-2a16-42e5-8a56-490b14f9cbcb req-a056a3eb-ff9c-451e-9651-9f8ae5911235 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:21.714759 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-672fa22b-2a16-42e5-8a56-490b14f9cbcb req-a056a3eb-ff9c-451e-9651-9f8ae5911235 service nova] Creating event network-changed:f6189040-7c7d-458c-9e40-8de4fe6b4d3e for instance d9783578-c61c-4c20-b25a-ffcd8257be4d on hv-cinder-85164 Aug 24 17:28:21.719828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-672fa22b-2a16-42e5-8a56-490b14f9cbcb req-a056a3eb-ff9c-451e-9651-9f8ae5911235 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045390 Aug 24 17:28:21.720950 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 178/337] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:28:22.009614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:22.010223 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:22.017292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:22.017795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:22.018241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:22.018966 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:22.019431 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:22.019868 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:22.174536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:22.183931 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f3fd8120-9ab4-43e1-a83a-e9a2b571d250 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.180069 Aug 24 17:28:22.195036 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:22.196450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:22.198317 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 160/338] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:22 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:22.208705 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:22.209254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:22.209791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:22.210509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:22.211024 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:22.214742 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:22.313842 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:22.324017 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-15e4702d-facf-4ba5-a4b1-e023002304ec tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1266 microversion: 2.1 time: 0.133086 Aug 24 17:28:22.324615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 179/339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:22 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:22.545505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:22.546144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:22.553544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:22.553544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:22.564847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:22.564847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:22.564847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:22.564847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:22.771150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:22.782090 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d502f72c-28e3-4344-a0a3-6ade5a53c8c0 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.240622 Aug 24 17:28:22.783308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 161/340] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:22 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:23.205500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:23.206120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:23.213439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:23.213921 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:23.214351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:23.215064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:23.215515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:23.215933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:23.346524 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:23.347275 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:23.354584 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:23.355428 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:23.356084 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:23.356928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:23.364616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:23.365873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:23.366706 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2ee8258c-9f9b-4abe-89e1-859f548b399f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.165213 Aug 24 17:28:23.367135 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:23.373136 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 180/341] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:23 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:23.435273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:23.442351 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de367b10-2845-4ed1-ab8b-d452e6a431bb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1284 microversion: 2.1 time: 0.099770 Aug 24 17:28:23.443307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 162/342] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:23 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:23.804334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:23.804855 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:23.811326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:23.811831 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:23.812255 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:23.812950 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:23.813472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:23.813896 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:23.989319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:24.002680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cb1a6f04-9990-4403-bf0c-2c0faa26b1fe tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.201944 Aug 24 17:28:24.003961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 181/343] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:23 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:24.388027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:24.388627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:24.395696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:24.396117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:24.396557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:24.397260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:24.397714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:24.398143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:24.469625 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:24.470330 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:24.472689 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:24.478198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:24.478687 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:24.479229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:24.480028 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:24.480555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:24.480997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:24.577064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:24.586632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-16523356-01f7-4cd6-be09-f064dbba74a4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.202601 Aug 24 17:28:24.588222 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 163/344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:24 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:24.661310 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:24.669543 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8ebd6658-5c8a-4cba-945b-8e0f3f6de258 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1326 microversion: 2.1 time: 0.205592 Aug 24 17:28:24.670116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 182/345] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:24 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1326 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:25.036516 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:25.037140 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:25.043805 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:25.044273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:25.044941 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:25.046434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:25.046434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:25.046779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:25.216226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:25.224303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97f47547-c7d8-46ac-aa03-50d17eb44814 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.191571 Aug 24 17:28:25.224876 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 164/346] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:25 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:25.610146 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:25.610146 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:25.617906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:25.618585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:25.619102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:25.619809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:25.620266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:25.642401 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:25.703590 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:25.703590 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:25.703590 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:25.704186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:25.704700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:25.706223 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:25.706722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:25.707525 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:25.863270 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:25.879974 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-dc83fd45-729d-40f8-a15c-8c99286e99de tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.274663 Aug 24 17:28:25.891590 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 183/347] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:25 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:25.944603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:25.956709 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-67cf962e-fba5-4ce1-a6be-cf1c1ea2d1bc tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1326 microversion: 2.1 time: 0.269324 Aug 24 17:28:25.957845 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 165/348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:25 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1326 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:26.246673 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:26.247327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:26.253514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:26.254004 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:26.254442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:26.255173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:26.255634 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:26.256350 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:26.417572 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:26.424818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5e142bc7-13c2-4709-8bb7-1c30387a3cbd tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.182417 Aug 24 17:28:26.425597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 184/349] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:26 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:26.696460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-f880d285-068f-4809-8531-879d000ae6bb req-3b69bbdb-eed0-4c77-909b-47ede19ff4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c781d7-ae05-4262-8cd4-c20386eb5bac", "tag": "95c98af6-52b4-408c-9c7f-9301a1f45d73"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:26.708561 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f880d285-068f-4809-8531-879d000ae6bb req-3b69bbdb-eed0-4c77-909b-47ede19ff4f1 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:26.709458 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f880d285-068f-4809-8531-879d000ae6bb req-3b69bbdb-eed0-4c77-909b-47ede19ff4f1 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:26.709458 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-f880d285-068f-4809-8531-879d000ae6bb req-3b69bbdb-eed0-4c77-909b-47ede19ff4f1 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:26.721278 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-f880d285-068f-4809-8531-879d000ae6bb req-3b69bbdb-eed0-4c77-909b-47ede19ff4f1 service nova] Creating event network-changed:95c98af6-52b4-408c-9c7f-9301a1f45d73 for instance 90c781d7-ae05-4262-8cd4-c20386eb5bac on hv-cinder-85164 Aug 24 17:28:26.726678 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-f880d285-068f-4809-8531-879d000ae6bb req-3b69bbdb-eed0-4c77-909b-47ede19ff4f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038272 Aug 24 17:28:26.728031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 166/350] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:28:26.904161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:26.904864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:26.911193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:26.911672 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:26.912112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:26.912794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:26.913246 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:26.913720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:26.987456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:26.988068 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:26.996868 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:26.997484 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:26.998091 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:26.999181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:27.000446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:27.000446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:27.016371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:27.088807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:27.106638 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d5060451-849c-452c-926d-12f64c275b2f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.206088 Aug 24 17:28:27.108207 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 185/351] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:26 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:27.161351 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:27.170185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33ae4851-3688-43e3-8922-96a63c547d2b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.187377 Aug 24 17:28:27.170782 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 167/352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:26 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:27.452178 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:27.452986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:27.459891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:27.460386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:27.460826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:27.462187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:27.462651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:27.463124 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:27.622965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:27.630745 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-73230d9f-8123-46a5-ab93-4753c7354634 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.182692 Aug 24 17:28:27.631355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 186/353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:27 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:28.133129 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:28.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:28.143295 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:28.143795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:28.144241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:28.144960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:28.145425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:28.145878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:28.204093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:28.205242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:28.213006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:28.213993 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:28.215111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:28.217075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:28.218177 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:28.219057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:28.356825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:28.366961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-df1021ab-3162-4877-a96c-6b7ce5cb026a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.241090 Aug 24 17:28:28.387181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 168/354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:28 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:28.417240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:28.425325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-48fd3f17-8efb-46d1-b9e7-a18f7c8f76ba tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.228641 Aug 24 17:28:28.425902 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 187/355] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:28 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:28.652860 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:28.653485 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:28.655724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:28.662759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:28.663290 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:28.663753 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:28.664500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:28.667511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:28.667972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:28.833423 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:28.848072 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7dbc2af0-4e75-4cbf-8191-4da3d64dffb4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.199716 Aug 24 17:28:28.848952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 169/356] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:28 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:29.417899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:29.417899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:29.417899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=12 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:29.417899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:29.419082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:29.419082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:29.419082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:29.419464 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:29.419916 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:29.449001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:29.450491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:29.458537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:29.459220 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:29.460207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:29.461169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:29.461875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:29.462513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:29.627283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:29.639128 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3235964f-1edb-4dea-b6de-c555980c574e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.239267 Aug 24 17:28:29.640049 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 188/357] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:29 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:29.649619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-46739921", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-898876491", "security_groups": [{"name": "tempest-secgroup-smoke-561477544"}], "block_device_mapping_v2": [{"uuid": "95dad41f-90f2-4662-be14-3b72aea50d23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5acc8120-3236-4503-932d-c28186671d3c"}]}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:29.654017 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:29.662415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-595b96f8-6a50-4441-bc0a-1ea0f0aecc84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.220425 Aug 24 17:28:29.663352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 170/358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:29 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:29.812522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] validate_networks() for [('5acc8120-3236-4503-932d-c28186671d3c', None, None, None, None, None)] {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:28:29.871281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:29.871926 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:29.878872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:29.879400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:29.879853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:29.880763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:29.881424 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:29.881857 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:30.055686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:30.108649 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:30.117278 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fff86f3c-d7ee-4337-9c29-c43f46bad74b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.251471 Aug 24 17:28:30.117691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 171/359] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:29 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:30.357247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:28:30.357636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:28:30.358153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:28:30.358812 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:28:30.359477 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:28:30.369623 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:30.370043 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:30.370481 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:30.371247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:30.371713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:30.372138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:30.390241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Getting quotas for project 036fc4bf065249e29d0e1e90d23bae19. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:28:30.394820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Getting quotas for user 47da700d7d0f4d5cb1ea984a82d643bf and project 036fc4bf065249e29d0e1e90d23bae19. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:28:30.463130 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:28:30.466101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95dad41f-90f2-4662-be14-3b72aea50d23',volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:28:30.676629 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:30.677345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:30.684815 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:30.685349 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:30.685787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:30.686532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:30.687013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:30.693731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:30.846137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:30.855970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0d12dcf2-7570-4a13-b567-bde9be04214c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.183176 Aug 24 17:28:30.856733 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 172/360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:30 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:30.863334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:30.864240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:30.872203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:30.872940 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:30.873608 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:30.881126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:30.881957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:30.882563 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:31.027450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5faa9f29-da04-48e9-85ed-2c9c9b2f1e36 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.385474 Aug 24 17:28:31.028980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 189/361] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:28:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:28:31.035042 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:31.043161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-19af350a-7d41-4390-b038-5f7bf436c9a8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:31.043842 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-19af350a-7d41-4390-b038-5f7bf436c9a8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:31.049924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5305162a-772f-4e70-a5c8-b83f5804262e tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.191434 Aug 24 17:28:31.056979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 173/362] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:30 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:31.137936 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-19af350a-7d41-4390-b038-5f7bf436c9a8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:31.138488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:31.139489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:31.146448 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-19af350a-7d41-4390-b038-5f7bf436c9a8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1092 microversion: 2.1 time: 0.109726 Aug 24 17:28:31.147160 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 190/363] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:31 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1092 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:31.151040 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:31.155505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:31.156143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:31.157039 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:31.157655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:31.158241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:31.340567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:31.350087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c93e1eb3-5266-4076-935b-69f14d00bed9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.217003 Aug 24 17:28:31.350679 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 174/364] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:31 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:31.878398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:31.878844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:31.885619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:31.886113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:31.886545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:31.887329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:31.887782 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:31.888199 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:32.042247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:32.050380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-92ca8efb-c644-453e-bf8b-5086990aba4d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.176381 Aug 24 17:28:32.051372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 191/365] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:31 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:32.091151 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:32.092244 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:32.104160 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:32.105042 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:32.105795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:32.107023 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:32.107822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:32.108602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:32.168222 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2bd4d20a-e5cf-43b1-a219-4e675e412b6d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:32.169064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2bd4d20a-e5cf-43b1-a219-4e675e412b6d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:32.236183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2bd4d20a-e5cf-43b1-a219-4e675e412b6d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:32.251821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2bd4d20a-e5cf-43b1-a219-4e675e412b6d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1092 microversion: 2.1 time: 0.087805 Aug 24 17:28:32.252371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 192/366] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:32 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1092 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:32.300248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:32.308381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c4426ca-935e-4f95-9fad-69318c2d79a9 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.225367 Aug 24 17:28:32.308949 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 175/367] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:32 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:32.372329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:32.372929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:32.378971 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:32.379459 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:32.379928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:32.380621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:32.381074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:32.381498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:32.538090 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:32.540357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:32.548942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2595bd58-dc17-4b1a-9ea6-07a8bf6ba74e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.180037 Aug 24 17:28:32.548942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 193/368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:32 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:33.072788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:33.073435 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:33.080714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:33.081981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:33.082416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:33.083201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:33.083662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:33.084083 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:33.098218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-b4852f9e-b84a-4260-93a7-af1fadb8ce89 req-535e2ec8-ae31-4fb5-989c-c7e56d6b5d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9783578-c61c-4c20-b25a-ffcd8257be4d", "name": "network-vif-plugged", "status": "completed", "tag": "f6189040-7c7d-458c-9e40-8de4fe6b4d3e"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:33.112200 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-b4852f9e-b84a-4260-93a7-af1fadb8ce89 req-535e2ec8-ae31-4fb5-989c-c7e56d6b5d42 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:33.112818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-b4852f9e-b84a-4260-93a7-af1fadb8ce89 req-535e2ec8-ae31-4fb5-989c-c7e56d6b5d42 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:33.113317 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-b4852f9e-b84a-4260-93a7-af1fadb8ce89 req-535e2ec8-ae31-4fb5-989c-c7e56d6b5d42 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:33.147146 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-b4852f9e-b84a-4260-93a7-af1fadb8ce89 req-535e2ec8-ae31-4fb5-989c-c7e56d6b5d42 service nova] Creating event network-vif-plugged:f6189040-7c7d-458c-9e40-8de4fe6b4d3e for instance d9783578-c61c-4c20-b25a-ffcd8257be4d on hv-cinder-85164 Aug 24 17:28:33.154039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-b4852f9e-b84a-4260-93a7-af1fadb8ce89 req-535e2ec8-ae31-4fb5-989c-c7e56d6b5d42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059772 Aug 24 17:28:33.155793 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 194/369] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:28:33.281465 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:33.281465 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:33.293674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:33.294256 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:33.294768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:33.296714 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:33.301362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:33.301948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:33.340427 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:33.351376 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-233e2030-6b6e-4512-93ae-5c3e2cee1d9c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.283009 Aug 24 17:28:33.352364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 176/370] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:33 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:33.369651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:33.370284 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:33.377547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:33.378094 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:33.378546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:33.379439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:33.379906 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:33.380398 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:33.413254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:33.422185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-804e3317-cb7e-4fcc-a9c2-b02caae454bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1142 microversion: 2.1 time: 0.151556 Aug 24 17:28:33.422931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 195/371] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:33 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1142 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:33.535202 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:33.543645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1bd59149-e269-4962-b000-909e157f2afb tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.189949 Aug 24 17:28:33.544233 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 177/372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:33 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:33.568773 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:33.569385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:33.575997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:33.576479 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:33.576906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:33.577593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:33.578042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:33.578462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:33.728724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:33.737223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e4839fcd-4ab9-436a-a42b-29d78ce16fa7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.172296 Aug 24 17:28:33.737894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 196/373] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:33 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:34.373199 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:34.373812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:34.380271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.380759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.381201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.381887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.382344 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.382774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.443321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:34.443969 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:34.450048 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.450540 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.451078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.451771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.452415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.452900 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.549708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:34.555497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:34.564511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73e32b2b-f904-4901-b5a6-7f13bc34f232 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1500 microversion: 2.1 time: 0.195133 Aug 24 17:28:34.565201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 178/374] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:34 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:34.569995 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:34.570710 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:34.577694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.580636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.580636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.580636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.580636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.580983 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.581617 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-04e9f093-cb73-490c-882c-8367efe961f0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1134 microversion: 2.1 time: 0.142193 Aug 24 17:28:34.582368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 197/375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:34 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1134 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:34.595276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1bbb925-781c-49c6-b4b2-b614715f4d3a"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:34.597805 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:34.605338 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.605837 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.606275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.607184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.607781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.608280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.633624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] HTTP exception thrown: Cannot 'attach_volume' instance 509a6e8e-d774-492b-9618-7de5caf2955f while it is in vm_state rescued Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Request method failure captured: Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: POST /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f/os-volume_attachments HTTP/1.1 Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 74 Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8leyUT8LR9_joBp5WcTRObVQ1206G5ZdQoG9THeHLiJNiHLOsvuazAWZKz1rXGxK2Kq6v_grcLjSgk1PqNuH-i8QeGG2CWBjJ8NnKmRjvoyTk79WH-fY3a7lhqHqbUNdoCRWQYR3F4c3wy8hXHbVz0rp6MFYehuyE9TI0_T4utcag Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:28:34.635515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf9b8b1e5c0f4021ae5f40c11c962222", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 0696e6f707274727b57a9a7493c47664 Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {"volumeAttachment": {"volumeId": "c1bbb925-781c-49c6-b4b2-b614715f4d3a"}} Aug 24 17:28:34.636922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Cannot 'attach_volume' instance 509a6e8e-d774-492b-9618-7de5caf2955f while it is in vm_state rescued Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'server_id': '509a6e8e-d774-492b-9618-7de5caf2955f', 'body': {'volumeAttachment': {'volumeId': 'c1bbb925-781c-49c6-b4b2-b614715f4d3a'}}} Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 509a6e8e-d774-492b-9618-7de5caf2955f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:28:34.637613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 509a6e8e-d774-492b-9618-7de5caf2955f while it is in vm_state rescued Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:28:34.638676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:28:34.639760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:28:34.639760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:28:34.639760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 509a6e8e-d774-492b-9618-7de5caf2955f while it is in vm_state rescued Aug 24 17:28:34.639760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:28:34.639760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Returning 409 to user: Cannot 'attach_volume' instance 509a6e8e-d774-492b-9618-7de5caf2955f while it is in vm_state rescued {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:28:34.639760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3282c4cd-a274-48da-8a62-92def5266234 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053453 Aug 24 17:28:34.639760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 198/376] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:28:34 2022] POST /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:28:34.648039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a4e67a24-f3d5-43f4-a106-2b57b0d264c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:34.649558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a4e67a24-f3d5-43f4-a106-2b57b0d264c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:34.656472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4e67a24-f3d5-43f4-a106-2b57b0d264c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.657054 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4e67a24-f3d5-43f4-a106-2b57b0d264c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.657586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4e67a24-f3d5-43f4-a106-2b57b0d264c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.658545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4e67a24-f3d5-43f4-a106-2b57b0d264c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.659147 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4e67a24-f3d5-43f4-a106-2b57b0d264c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.659676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4e67a24-f3d5-43f4-a106-2b57b0d264c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.779458 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:34.787162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d209c52b-f5c8-492b-877c-262ebbc9ef84 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.220711 Aug 24 17:28:34.787737 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 179/377] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:34 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:34.792692 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:34.793291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:34.798882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.799398 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.799905 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.800527 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.804013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.804013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.937765 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:34.943929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a4e67a24-f3d5-43f4-a106-2b57b0d264c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f/action" status: 202 len: 0 microversion: 2.1 time: 0.299586 Aug 24 17:28:34.947089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 199/378] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:28:34 2022] POST /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:28:34.953777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:34.954483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:34.957857 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ef230181-5fbe-4fce-8b88-82ebba5f3ec2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.160118 Aug 24 17:28:34.966423 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 180/379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:34 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:34.968537 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.969166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.969826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:34.970781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:34.971509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:34.972002 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:35.121961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:35.131129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-78226f03-b309-45b3-8d13-fdf048eb33a8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.181391 Aug 24 17:28:35.143308 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 200/380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:34 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:35.609342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:35.609929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:35.616463 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:35.616917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:35.617353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:35.618671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:35.619153 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:35.619681 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:35.700157 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:35.710031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0a73be5-7ed5-4497-8437-c6f5a6594acf tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1134 microversion: 2.1 time: 0.104678 Aug 24 17:28:35.710613 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 181/381] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:35 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1134 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:35.815503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:35.817152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:35.823320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:35.824604 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:35.824604 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:35.824911 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:35.825366 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:35.825794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:35.964735 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:35.972820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c3f2575b-0e5b-48c0-a071-c107639172d4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.161322 Aug 24 17:28:35.973399 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 201/382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:35 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:35.981646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:35.984995 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:35.988357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:35.988836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:35.989354 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:35.990038 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:35.990488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:35.990932 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:36.132865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:36.140632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-540c65b6-ea2f-47f6-991c-cf80305585e2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.164020 Aug 24 17:28:36.141198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 182/383] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:35 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:36.153138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:36.153743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:36.159946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:36.160431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:36.160915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:36.161608 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:36.162060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:36.162491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:36.295411 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:36.303250 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bdf3321d-4aad-45cd-a8ad-3643ec845245 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.154383 Aug 24 17:28:36.303821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 202/384] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:36 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:36.735419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:36.735419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:36.744217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:36.745115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:36.745922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:36.747342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:36.748271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:36.749027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:36.838407 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:36.851312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fc381beb-ec18-45f4-8332-462bb55227b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1134 microversion: 2.1 time: 0.122502 Aug 24 17:28:36.852454 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 183/385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:36 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1134 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:37.001294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:37.002047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:37.009839 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:37.010337 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:37.011529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:37.012268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:37.012734 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:37.013267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:37.165139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:37.166891 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:37.175557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:37.176311 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:37.176903 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:37.178190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:37.178822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:37.179441 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:37.213509 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:37.221174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:37.230663 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8edc7bda-f833-465f-8d45-659cfa8d8a07 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.240355 Aug 24 17:28:37.231657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 203/386] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:36 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:37.333654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:37.334353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:37.342498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:37.343022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:37.343566 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:37.344661 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:37.345217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:37.345647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:37.717884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:37.729802 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d51c6e20-1d08-4967-b86c-d7bdb9be015c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.571352 Aug 24 17:28:37.731197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 184/387] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:37 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:37.761933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:37.773095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bca3f6a2-c2ed-41f7-b57d-23f17cf4d1a5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.445449 Aug 24 17:28:37.775162 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 204/388] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:37 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:37.885212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:37.885987 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:37.893173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:37.893662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:37.894105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:37.894802 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:37.895288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:37.895713 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:37.976996 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:37.985239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ea7d6fa3-0268-4281-8387-e0e400ae5009 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1190 microversion: 2.1 time: 0.104701 Aug 24 17:28:37.985840 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 185/389] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:37 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1190 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:38.256087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:38.256656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:38.263252 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:38.263764 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:38.264190 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:38.264868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:38.265320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:38.265736 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:38.404285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:38.412022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-de49c653-6776-45ba-814c-cf7e2e1cd532 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.159916 Aug 24 17:28:38.412679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 205/390] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:38 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:38.761946 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:38.762673 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:38.769470 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:38.778240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:38.778240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:38.778240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:38.778240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:38.778687 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:38.807040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:38.807040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:38.812786 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:38.813471 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:38.814198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:38.815390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:38.816166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:38.816880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:39.007981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:39.021954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-982de4a6-84b4-4e11-af04-4c45019aeb62 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1315 microversion: 2.1 time: 0.263529 Aug 24 17:28:39.024964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 186/391] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:38 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:39.037169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:39.038736 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:39.051836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:39.052351 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:39.052837 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:39.053557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:39.054225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:39.054660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:39.095266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:39.104304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-48b94b1e-4ddf-469a-9aa8-98e10abc9cd4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.306660 Aug 24 17:28:39.105302 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 206/392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:38 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:39.141501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:39.150260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-51fa901d-5df4-4eff-a04a-a5f36f95abe9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1190 microversion: 2.1 time: 0.123702 Aug 24 17:28:39.150840 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 187/393] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:39 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1190 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:39.437192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:39.438318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:39.445153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:39.446152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:39.447519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:39.447519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:39.447781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:39.448203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:39.546991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7d4fdece-3a59-4c68-8967-e6ba8f44fe6b req-37987588-f924-45ed-9753-1a7af1f4cc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c781d7-ae05-4262-8cd4-c20386eb5bac", "name": "network-vif-plugged", "status": "completed", "tag": "95c98af6-52b4-408c-9c7f-9301a1f45d73"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:39.570065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7d4fdece-3a59-4c68-8967-e6ba8f44fe6b req-37987588-f924-45ed-9753-1a7af1f4cc33 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:39.571143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7d4fdece-3a59-4c68-8967-e6ba8f44fe6b req-37987588-f924-45ed-9753-1a7af1f4cc33 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:39.571574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7d4fdece-3a59-4c68-8967-e6ba8f44fe6b req-37987588-f924-45ed-9753-1a7af1f4cc33 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:39.587339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7d4fdece-3a59-4c68-8967-e6ba8f44fe6b req-37987588-f924-45ed-9753-1a7af1f4cc33 service nova] Creating event network-vif-plugged:95c98af6-52b4-408c-9c7f-9301a1f45d73 for instance 90c781d7-ae05-4262-8cd4-c20386eb5bac on hv-cinder-85164 Aug 24 17:28:39.593015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7d4fdece-3a59-4c68-8967-e6ba8f44fe6b req-37987588-f924-45ed-9753-1a7af1f4cc33 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049739 Aug 24 17:28:39.593626 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 188/394] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:28:39.619314 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:39.627483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d83e757e-9ac7-4884-b23d-dfd6046e354f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.197780 Aug 24 17:28:39.628073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 207/395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:39 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:40.053998 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:40.056018 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:40.062891 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.063703 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.064447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.065452 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.066150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.066792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.128850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:40.130120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:40.139540 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.140209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.140664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.144514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.144514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.144514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.332404 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:40.341925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d4f82812-ea31-4699-8c8e-c9e8f1014b0f tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1465 microversion: 2.1 time: 0.295428 Aug 24 17:28:40.343425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 189/396] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:40 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1465 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:40.348684 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:40.349534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:40.367102 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.367637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.368134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.368855 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.369312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.369738 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.379645 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:40.390226 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:40.401762 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3448b285-4d4d-4b53-8ee8-d271522fd814 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.279891 Aug 24 17:28:40.403227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 208/397] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:40 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:40.421565 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:40.427218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:40.434647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.435361 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.435810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.436704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.437166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.437586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.470234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:28:40.501261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:40.507522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:40.516559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a070f37-ed53-4ad8-979c-933cfffe6205 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1198 microversion: 2.1 time: 0.171442 Aug 24 17:28:40.517918 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 190/398] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:40 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1198 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:40.653490 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:40.654108 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:40.660730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.661224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.661663 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.662362 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.662813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.663264 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.775332 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b85f565e-b257-443b-b8ce-520dcc6cdf31 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 204 len: 0 microversion: 2.1 time: 0.361632 Aug 24 17:28:40.778711 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 209/399] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:28:40 2022] DELETE /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:28:40.787626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:40.787626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:40.794599 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.795869 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.796220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.797422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:40.798610 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:40.799254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:40.829860 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:40.842453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fcb225f7-3ceb-488f-886e-9f3a54404018 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.189604 Aug 24 17:28:40.842453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 191/400] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:40 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:40.963104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:40.971252 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1087383a-5fea-46b4-8b46-29767ed576f9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.190699 Aug 24 17:28:40.971847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 210/401] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:40 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:41.425310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:41.425924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:41.433381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:41.433880 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:41.434313 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:41.435056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:41.435517 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:41.435944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:41.543700 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:41.544521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:41.550806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:41.551491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:41.551927 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:41.552619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:41.553068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:41.553497 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:41.572468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:41.580039 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe4bd8c2-422d-441a-9f57-427b478135d6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.158729 Aug 24 17:28:41.580674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 192/402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:41 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:41.719260 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:41.727825 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-dc2adfbe-6a81-4c0a-82b4-f0b650b10b4e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.189553 Aug 24 17:28:41.728405 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 211/403] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:41 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:41.859764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:41.860426 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:41.866470 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:41.866991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:41.868249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:41.869425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:41.870307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:41.871046 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:41.992637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:41.993400 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:41.999892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:42.000521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:42.000964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:42.001701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:42.002161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:42.002589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:42.007522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:42.015549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7b0bd1d3-d50f-4c94-a8ca-fcde53b7bd89 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.159689 Aug 24 17:28:42.016230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 193/404] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:41 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:42.141433 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:42.150288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3e7dc6b5-db12-4711-8cde-b47d4e340760 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.161532 Aug 24 17:28:42.150874 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 212/405] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:41 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:42.600331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:42.600978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:42.607439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:42.607925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:42.608366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:42.609054 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:42.609511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:42.610033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:42.748827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:42.749460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:42.749587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:42.751608 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=10 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:42.756855 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:42.757425 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:42.757544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1bcbe6f5-902d-4922-8f33-39b6791d0c98 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.160868 Aug 24 17:28:42.759432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:42.759590 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 194/406] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:42 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:42.759683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:42.759769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:42.760189 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:42.900963 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:42.909169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e26dc03c-82d0-4c38-9bbe-e7423a7f4d00 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.164148 Aug 24 17:28:42.909758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 213/407] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:42 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:43.038123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:43.038623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:43.041149 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:43.045986 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:43.046473 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:43.046934 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:43.047619 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:43.048066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:43.048487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:43.171195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:43.171843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:43.173722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:43.178579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:43.179102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:43.179531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:43.180810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:43.181261 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:43.181686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:43.182315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:43.190504 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d2c0260-0731-497e-8fca-0c8ed1b300f6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.156554 Aug 24 17:28:43.191128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 195/408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:43 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:43.320991 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:43.328880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-76728e9a-8a45-40fa-8b1a-3aaa1bea022b tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.161800 Aug 24 17:28:43.329444 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 214/409] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:43 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:43.779579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:43.780184 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:43.786829 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:43.787342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:43.787771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:43.788445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:43.788938 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:43.789858 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:43.930741 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:43.931385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:43.937929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:43.938458 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:43.938596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:43.939101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:43.939964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:43.940429 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:43.940863 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:43.947680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e37d68c-d923-4e3f-850f-f63ca5392f82 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.171840 Aug 24 17:28:43.949636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 196/410] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:43 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:44.107563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:44.115274 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b9b33b15-6af5-4941-8025-6254d4254fed tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.189429 Aug 24 17:28:44.115836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 215/411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:43 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:44.211947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:44.212456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:44.218388 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:44.218871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:44.219348 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:44.220037 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:44.220494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:44.220923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:44.350431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:44.351071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:44.355153 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:44.358228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:44.358715 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:44.359174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:44.359904 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:44.360592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:44.361021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:44.363008 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0f18e4a-a119-441b-8309-376593aaea36 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.155451 Aug 24 17:28:44.363589 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 197/412] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:44 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:44.505609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:44.514636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f28d3ec4-08ce-4e0c-afe3-dcfd0a85c17a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.167886 Aug 24 17:28:44.515270 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 216/413] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:44 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:44.972423 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:44.973047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:44.979924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:44.980420 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:44.980864 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:44.981559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:44.982015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:44.982471 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:45.138356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:45.142722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:45.151649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:45.152004 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-232dabd5-69cf-4446-aee5-9913901f0f64 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.179481 Aug 24 17:28:45.152004 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 198/414] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:44 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:45.152149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:45.152149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:45.152149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:45.152998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:45.153514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:45.154154 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:45.289693 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:45.297591 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1e90db77-c147-445f-a808-a6d32d1b6842 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.158989 Aug 24 17:28:45.298158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 217/415] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:45 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:45.384879 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:45.385489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:45.391537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:45.392306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:45.392748 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:45.393448 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:45.393906 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:45.394333 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:45.538203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:45.539799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:45.540846 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:45.548636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5997423f-c942-4dba-9bdc-eb1a047b510b tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.166062 Aug 24 17:28:45.548636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 199/416] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:45 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:45.548890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:45.548890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:45.548890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:45.549125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:45.549575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:45.550009 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:45.704463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:45.712579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-288e5df6-04d3-4527-b09f-0b7217b71b46 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.179724 Aug 24 17:28:45.713218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 218/417] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:45 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:46.170777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:46.171332 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:46.177850 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:46.178356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:46.178799 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:46.179511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:46.180700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:46.181332 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:46.325458 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:46.326089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:46.333188 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:46.333674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:46.334107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:46.334798 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:46.335356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:46.335776 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:46.337024 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:46.345186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0411da6-43d1-4e1c-aef0-60c8be930e19 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.178786 Aug 24 17:28:46.345777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 200/418] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:46 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:46.474303 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:46.482179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-88761d0a-a8c8-413c-beea-089ecb74e6c3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.161638 Aug 24 17:28:46.482760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 219/419] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:46 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:46.568806 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:46.569416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:46.576129 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:46.576616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:46.577052 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:46.577745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:46.578198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:46.578622 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:46.594061 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:46.720166 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:46.727305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c4325e3-b1c0-4e18-a50e-7b5ccea765d2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.162175 Aug 24 17:28:46.727813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 201/420] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:46 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:46.733720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:46.734529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:46.740677 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:46.741172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:46.741610 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:46.742892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:46.743374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:46.743806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:46.882858 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:46.890966 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-92c7ba0d-69ed-4e68-a445-09130c5ef484 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.161253 Aug 24 17:28:46.891544 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 220/421] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:46 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:47.366210 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:47.366825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:47.373771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:47.374261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:47.374706 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:47.375430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:47.375886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:47.376315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:47.503110 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:47.503612 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:47.503730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:47.511677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ccd8be2d-7a7f-49fc-823f-0e145ad15291 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.149330 Aug 24 17:28:47.512491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 202/422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:47 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:47.514612 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:47.515158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:47.515582 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:47.516284 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:47.516744 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:47.517439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:47.649995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:47.657649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bfd9a5b8-0249-43d5-8e1d-8c5fe028dd9e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.158407 Aug 24 17:28:47.658283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 221/423] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:47 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:47.748619 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:47.749225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:47.755340 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:47.755828 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:47.756264 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:47.756960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:47.757442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:47.757867 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:47.905224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:47.911546 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:47.912171 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:47.913272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b7f17f24-3b00-4eeb-882e-b6364e5e5543 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.168656 Aug 24 17:28:47.913851 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 203/424] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:47 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:47.919332 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:47.919832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:47.920275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:47.920978 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:47.921437 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:47.921900 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:48.054114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:48.062555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4cf1b796-2f8b-4e8e-936b-d566a8fe57eb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.154777 Aug 24 17:28:48.063180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 222/425] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:47 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:48.535617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:48.536234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:48.542236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:48.542714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:48.543192 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:48.543885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:48.544344 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:48.544768 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:48.678548 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:48.679139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:48.679293 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:48.685823 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:48.686306 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:48.686743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:48.687195 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-95b097f9-48a9-49d0-a94a-e4f4d400e487 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.155581 Aug 24 17:28:48.687456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:48.687773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 204/426] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:48 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:48.687918 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:48.688323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:48.822500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:48.830303 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cf02f72c-daca-45f9-bd93-cf074e4c63c9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.155578 Aug 24 17:28:48.830890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 223/427] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:48 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:48.934232 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:48.934847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:48.941219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:48.941714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:48.942154 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:48.942856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:48.943347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:48.943778 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:49.082919 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:49.083057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:49.083529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:49.090211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:49.090731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:49.091093 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-07823a68-a984-4455-9aa6-7de28cb5fef6 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.161160 Aug 24 17:28:49.091223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:49.091878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 205/428] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:48 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:49.091986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:49.092619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:49.093050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:49.228891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:49.237281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c292a887-2575-4dbc-9ee3-e1071cba30e9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.158157 Aug 24 17:28:49.237861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 224/429] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:49 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:49.709625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:49.710322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:49.717398 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:49.717891 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:49.718303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:49.719007 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:49.719460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:49.719884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:49.851096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:49.851749 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:49.856386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:49.857874 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:49.858371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:49.858813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:49.859682 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:49.860128 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:49.860558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:49.864503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-181809b4-ab34-4a17-8bc0-ce27880ffee2 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.158760 Aug 24 17:28:49.865272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 206/430] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:49 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:49.879405 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:50.015764 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:50.024294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8bfe6589-7307-4c0a-9ac5-86bb07b9de77 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.176543 Aug 24 17:28:50.024864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 225/431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:49 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:50.112678 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:50.113287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:50.119383 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:50.119865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:50.120296 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:50.120997 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:50.121448 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:50.121870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:50.260965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:50.261720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:50.268522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:50.269042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:50.269702 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:50.270192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:50.270656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:50.271157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:50.285899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:50.294927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bef5fb15-91ad-4e4a-9b86-10813cf99472 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.186024 Aug 24 17:28:50.295986 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 207/432] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:50 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:50.408177 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:50.415991 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-079021cd-0044-40c5-bd6c-b60b0c40ae23 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.160719 Aug 24 17:28:50.417047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 226/433] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:50 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:50.886964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:50.886964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:50.893532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:50.894020 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:50.894464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:50.895217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:50.895672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:50.896102 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:51.041989 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:51.046595 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:51.047426 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:51.048979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6e09b8f7-790e-45e6-b3ca-d1a6011c243b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.167070 Aug 24 17:28:51.060935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 208/434] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:50 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:51.061167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:51.061167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:51.061167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:51.061167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:51.061643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:51.061643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:51.210528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:51.219955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9067cf4a-54fe-4653-b572-e92468f53517 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.176801 Aug 24 17:28:51.220963 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 227/435] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:51 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:51.315743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:51.316364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:51.323511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:51.331167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:51.331167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:51.331167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:51.331167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:51.331637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:51.436662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:51.437283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:51.443483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:51.443984 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:51.444416 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:51.455834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:51.455834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:51.455834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:51.511780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:51.521337 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ccab036-dd1d-48bb-8943-1b3e1dc9d2a2 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.209280 Aug 24 17:28:51.522634 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 209/436] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:51 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:51.620342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:51.629559 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d994ebbe-ae38-4d2b-9078-d18a81c6dc63 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.196767 Aug 24 17:28:51.630133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 228/437] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:51 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:52.071028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:52.071840 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:52.079595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:52.080472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:52.081231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:52.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:52.083071 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:52.083575 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:52.252719 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:52.254797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:52.268567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:52.274069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:52.274069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:52.274069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:52.274069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:52.274701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:52.291510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:52.309347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fbb50a88-3fd8-4efa-b217-a79d67bf5c40 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1508 microversion: 2.1 time: 0.242426 Aug 24 17:28:52.309936 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 210/438] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:52 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:52.475707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:52.486783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-7a4584de-bdb2-4204-9eec-7336c03d7303 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.242176 Aug 24 17:28:52.487415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 229/439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:52 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:52.560529 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:52.561607 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:52.573623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:52.574141 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:52.574588 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:52.575345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:52.575815 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:52.576253 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:52.664707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:52.665440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:52.672871 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:52.673761 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:52.674158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:52.674933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:52.679202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:52.679202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:52.790182 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:52.803948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cdb8d76a-63a4-49c8-ac1a-340eba85c319 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.249059 Aug 24 17:28:52.806083 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 211/440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:52 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:52.885151 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:52.894821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e7062115-caed-4558-87ad-0dc07490d3ce tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.234131 Aug 24 17:28:52.895453 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 230/441] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:52 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:52.941466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3f1b28b3-ec87-46d4-9e70-64e3b7b0b99f req-f1bb27e4-d133-44e9-b6fa-20d0a6b6f9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028a50e6-e905-4cc5-aaab-ad1dfe279845", "tag": "5c495910-bb43-41b8-bcdc-3755a81d9cc7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:28:52.957336 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3f1b28b3-ec87-46d4-9e70-64e3b7b0b99f req-f1bb27e4-d133-44e9-b6fa-20d0a6b6f9c9 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:52.957830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3f1b28b3-ec87-46d4-9e70-64e3b7b0b99f req-f1bb27e4-d133-44e9-b6fa-20d0a6b6f9c9 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:52.958266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3f1b28b3-ec87-46d4-9e70-64e3b7b0b99f req-f1bb27e4-d133-44e9-b6fa-20d0a6b6f9c9 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:52.972611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3f1b28b3-ec87-46d4-9e70-64e3b7b0b99f req-f1bb27e4-d133-44e9-b6fa-20d0a6b6f9c9 service nova] Creating event network-changed:5c495910-bb43-41b8-bcdc-3755a81d9cc7 for instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 on hv-cinder-85164 Aug 24 17:28:52.981272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3f1b28b3-ec87-46d4-9e70-64e3b7b0b99f req-f1bb27e4-d133-44e9-b6fa-20d0a6b6f9c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046969 Aug 24 17:28:52.982014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 212/442] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:28:53.341680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:53.345355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:53.348953 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:53.349451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:53.349890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:53.350590 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:53.351079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:53.352073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:53.518065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:53.520322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:53.532478 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:53.534000 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:53.535347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:53.537681 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:53.537854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:53.539416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:53.556337 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:53.572529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0b322344-188b-4b21-bbb8-20972df2ba5f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1514 microversion: 2.1 time: 0.234551 Aug 24 17:28:53.573391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 231/443] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:53 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:53.755224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:53.766894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cde05c61-5b22-4385-a6da-977b21da2b2b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.260346 Aug 24 17:28:53.768311 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 213/444] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:53 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:53.826983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:53.827619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:53.834134 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:53.834629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:53.835117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:53.836422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:53.836888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:53.837318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:53.916599 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:53.917347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:53.924570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:53.925322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:53.925766 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:53.927069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:53.927734 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:53.928339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:54.035403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:54.045183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-daf6faa7-3f64-4dcf-b354-7eda72a1122c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.222503 Aug 24 17:28:54.048075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 232/445] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:53 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:54.140107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:54.146777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78df51ae-80d0-404a-b8fb-c69d37bdc3bf tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.234962 Aug 24 17:28:54.147583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 214/446] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:53 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:54.790622 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:54.791389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:54.797914 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:54.798410 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:54.798849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:54.799643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:54.800035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:54.800461 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:54.945000 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:54.953059 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c190fb81-ec89-48e8-b38a-cf968e4c4e3d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.167318 Aug 24 17:28:54.953653 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 233/447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:54 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:55.067616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:55.068236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:55.075609 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:55.076103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:55.076540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:55.077246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:55.077700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:55.078126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:55.168482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:55.169107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:55.176005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:55.176833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:55.177453 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:55.178188 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:55.178656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:55.179135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:55.239601 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:55.247975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-db8c0dd6-940b-459b-9185-64c916651b63 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.184121 Aug 24 17:28:55.248565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 215/448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:55 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:55.363963 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:55.373724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-75d077de-1e85-408d-81ae-b1a4ba95b94d tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.209168 Aug 24 17:28:55.374321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 234/449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:55 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:55.974687 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:55.975335 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:55.984278 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:55.985028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:55.985694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:55.986771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:55.987505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:55.988180 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:56.133579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:56.142606 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c1e129f9-188b-49da-9742-d82ab1431830 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.171446 Aug 24 17:28:56.143540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 216/450] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:55 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:56.270841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:56.271403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:56.277995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:56.278955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:56.279397 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:56.280096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:56.280548 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:56.280975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:56.395854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:56.396528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:56.403016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:56.403532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:56.403947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:56.404634 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:56.405087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:56.405513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:56.412577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:56.420933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cd5fc120-f76d-4b64-970f-9c5e41868e40 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.154293 Aug 24 17:28:56.421515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 235/451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:56 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:56.568841 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:56.577292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b254c7d8-7938-416b-8637-1329deb8996e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.185569 Aug 24 17:28:56.577865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 217/452] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:56 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:57.164771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:57.165432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:57.172167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:57.172679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:57.173123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:57.173840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:57.174301 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:57.174733 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:57.320453 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:57.329658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8200f861-d72a-4f6c-97f4-7b9a2239bd15 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.168861 Aug 24 17:28:57.330255 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 236/453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:57 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:57.441831 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:57.442792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:57.450197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:57.450729 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:57.451373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:57.452143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:57.452640 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:57.453131 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:57.598586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:57.599234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:57.606802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:57.607560 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:57.608110 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:57.608937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:57.609515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:57.610062 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:57.626321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:57.628970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:57.635127 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a77ecd9-893c-4dfb-86f7-78adfa22ed35 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.197604 Aug 24 17:28:57.635806 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 218/454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:57 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:57.750164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:57.758771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a55f5066-bd41-44d9-8229-51e32e3412bb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.164623 Aug 24 17:28:57.759430 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 237/455] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:57 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:28:58.352026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:58.352633 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:58.358687 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:58.359203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:58.359638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:58.360330 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:58.360780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:58.361198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:58.502370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:58.513869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-44246539-d337-42d9-81b4-d6c7574e1394 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.165971 Aug 24 17:28:58.514466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 219/456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:58 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:58.712746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:58.713295 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:58.719388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:58.719876 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:58.720313 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:58.721000 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:58.721458 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:58.721888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:58.780595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:58.781212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:58.787329 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:58.787833 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:58.788280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:58.789811 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:58.790281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:58.790712 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:58.901026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:58.908996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d17d350c-07f8-454e-bcf8-b9d67b12444f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.200708 Aug 24 17:28:58.909586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 238/457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:58 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:58.945749 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:58.953411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-32916d04-1b8c-420e-88b4-21f4b49ef9e4 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.176884 Aug 24 17:28:58.953986 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 220/458] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:58 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:59.537604 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:59.538317 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:59.545537 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:59.546012 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:59.546891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:59.547620 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:59.548072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:59.548502 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:59.720251 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:28:59.733482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1fc30f59-e17e-4b6f-9c8b-fe19c6f2d32e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.201822 Aug 24 17:28:59.734081 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 239/459] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:59 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:28:59.933617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:59.934254 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:59.943606 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:59.944874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:59.945648 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:59.947158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:59.947638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:59.948078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:59.978679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:28:59.983299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:28:59.992500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:59.993862 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:59.995188 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:28:59.996120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:28:59.996666 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:28:59.997176 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:00.172741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:00.180675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-14cf3dd7-05c9-4ad3-96a0-635d33d0996f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.254447 Aug 24 17:29:00.181251 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 221/460] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:59 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:00.183452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:00.191334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b60575a7-5919-461d-b884-5adee00a3ada tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.219976 Aug 24 17:29:00.191902 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 240/461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:28:59 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:00.761352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:00.761995 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:00.768317 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:00.768799 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:00.769233 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:00.769911 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:00.770367 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:00.770922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:00.915815 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:00.924658 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e90b3a7a-6848-462e-b91b-cfad8c449459 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.167100 Aug 24 17:29:00.925165 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 222/462] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:00 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:01.204726 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:01.205629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:01.215586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:01.215852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:01.216361 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:01.216468 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:01.217079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:01.218219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:01.218702 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:01.219294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:01.223746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:01.224226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:01.224699 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:01.225399 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:01.225845 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:01.226271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:01.456660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:01.460276 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:01.469677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9edada9f-a741-4d2d-8759-4650cc30b7b2 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.260631 Aug 24 17:29:01.470637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 223/463] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:01 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:01.472195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-085af13e-1f56-4b98-9343-894d82e8447c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1314 microversion: 2.1 time: 0.273257 Aug 24 17:29:01.472887 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 241/464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:01 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:01.834705 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3b19ff59-fcda-4c22-88ff-b7bfd48f3c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'create', calling method: .version_select at 0x7f3f302518b0>, body: {"keypair": {"name": "tempest-keypair-1873813858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpDKa6SmEyArF+m7bBzrqZ+KTHqcKUreiiCGzh6QNSNvF/5DCfQFzA80VJFYDpVlaLsXQKT3cJ9FSA2aifDyc9posAclfJHju+pPLoT7+vRgT03fUw25cq4AP47uPhtqg=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:01.858621 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-3b19ff59-fcda-4c22-88ff-b7bfd48f3c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Getting quotas for project cf9b8b1e5c0f4021ae5f40c11c962222. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:29:01.865797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-3b19ff59-fcda-4c22-88ff-b7bfd48f3c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Getting quotas for user 0696e6f707274727b57a9a7493c47664 and project cf9b8b1e5c0f4021ae5f40c11c962222. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:29:01.889225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b19ff59-fcda-4c22-88ff-b7bfd48f3c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [daf562fa-ccca-4003-a680-b6f23765f664] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 17:29:01.949522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:01.950410 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:01.958681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:01.959271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:01.960017 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:01.960877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:01.961536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:01.962117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:01.968112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:02.199625 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:02.207808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4e0cf1d9-da05-4acf-a906-743b0d79f2a1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1275 microversion: 2.1 time: 0.265126 Aug 24 17:29:02.208836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 242/465] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:01 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:02.492879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:02.493902 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:02.500817 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:02.501439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:02.502241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:02.503076 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:02.503612 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:02.504104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:02.781306 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:02.787637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d58e2d70-fb32-4695-898f-21d6480a25ad tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1471 microversion: 2.1 time: 0.298954 Aug 24 17:29:02.801813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 243/466] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:02 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:02.807677 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:02.808551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:02.818402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:02.826833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:02.826833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:02.826833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:02.826833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:02.827349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:02.900697 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b19ff59-fcda-4c22-88ff-b7bfd48f3c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [daf562fa-ccca-4003-a680-b6f23765f664] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40912. Aug 24 17:29:03.028893 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3b19ff59-fcda-4c22-88ff-b7bfd48f3c5b tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.198467 Aug 24 17:29:03.041333 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 224/467] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:29:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:29:03.048696 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:03.060672 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3d90f25d-5490-410f-b706-9ca890ca2576 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1498 microversion: 2.1 time: 0.257233 Aug 24 17:29:03.061064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 244/468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:02 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1498 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:03.233606 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:03.234799 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:03.245345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:03.246632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:03.247856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:03.250502 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:03.256433 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:03.256433 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:03.377668 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-379d8d22-9ed9-4053-b9c0-f4f0f182646e req-778238ad-0f72-467e-9211-3e98b755cfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9783578-c61c-4c20-b25a-ffcd8257be4d", "name": "network-vif-deleted", "tag": "f6189040-7c7d-458c-9e40-8de4fe6b4d3e"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:03.421992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-379d8d22-9ed9-4053-b9c0-f4f0f182646e req-778238ad-0f72-467e-9211-3e98b755cfc4 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:03.423808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-379d8d22-9ed9-4053-b9c0-f4f0f182646e req-778238ad-0f72-467e-9211-3e98b755cfc4 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:03.425361 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-379d8d22-9ed9-4053-b9c0-f4f0f182646e req-778238ad-0f72-467e-9211-3e98b755cfc4 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:03.446747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-379d8d22-9ed9-4053-b9c0-f4f0f182646e req-778238ad-0f72-467e-9211-3e98b755cfc4 service nova] Creating event network-vif-deleted:f6189040-7c7d-458c-9e40-8de4fe6b4d3e for instance d9783578-c61c-4c20-b25a-ffcd8257be4d on hv-cinder-85164 Aug 24 17:29:03.453096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-379d8d22-9ed9-4053-b9c0-f4f0f182646e req-778238ad-0f72-467e-9211-3e98b755cfc4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081740 Aug 24 17:29:03.454152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 245/469] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:29:03.537565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:03.556277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ffa3d32c-15cc-4865-87b6-20152c73ef06 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.328356 Aug 24 17:29:03.570706 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 225/470] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:03 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:03.810141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:03.811037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:03.822879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:03.823433 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:03.823931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:03.833197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:03.833197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:03.833197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:03.919489 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:03.932703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ff3c5884-44fb-4d91-9adf-03a84f036517 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1300 microversion: 2.1 time: 0.126728 Aug 24 17:29:03.933437 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 246/471] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:03 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:04.441282 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:04.441856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:04.451174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:04.451841 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:04.452674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:04.453598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:04.454064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:04.454496 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:04.484408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:29:04.579399 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:04.580259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:04.587014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:04.587508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:04.587954 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:04.588695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:04.589125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:04.589552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:04.748765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:04.757005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-dda605d7-bae4-4b14-9428-efb9019b6f08 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.182244 Aug 24 17:29:04.757733 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 247/472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:04 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:04.853587 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72ff3881-8f95-4058-8381-1e24c156a399 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "DELETE /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 204 len: 0 microversion: 2.1 time: 0.416040 Aug 24 17:29:04.854452 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 226/473] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:29:04 2022] DELETE /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:29:04.863580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:04.864367 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:04.871526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:04.872020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:04.872690 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:04.873185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:04.873642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:04.874068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:04.962712 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:04.964024 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:04.973370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:04.974429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:04.975247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:04.976789 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:04.977690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:04.978453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:05.070639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:05.085254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-64de4d8e-53c1-4f46-8b0f-6f53a58fc0b4 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1504 microversion: 2.1 time: 0.225723 Aug 24 17:29:05.090299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 248/474] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:04 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:05.099893 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:05.112285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5bdf52d2-3618-461d-8e94-65dd1eaab46c tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1300 microversion: 2.1 time: 0.156717 Aug 24 17:29:05.113582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 227/475] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:04 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:05.780629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:05.781505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:05.787553 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:05.788059 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:05.789021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:05.789798 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:05.790206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:05.790635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:05.940868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:05.955064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-983ce5a3-4aa0-40d2-a89e-4acf4e378720 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.178922 Aug 24 17:29:05.955866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 249/476] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:05 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:06.069465 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1880512255", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e086209-e46b-4d5d-918b-ba3ca2944349"}], "security_groups": [{"name": "tempest-securitygroup--947734176"}], "key_name": "tempest-keypair-1873813858", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:06.121035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:06.121856 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:06.129220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:06.129881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:06.130422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:06.131616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:06.133157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:06.133713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:06.253063 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] validate_networks() for [('9e086209-e46b-4d5d-918b-ba3ca2944349', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:29:06.369890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:06.377881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-13155a95-80bc-40b0-aa8a-ee2726f7f1bf tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1504 microversion: 2.1 time: 0.263651 Aug 24 17:29:06.378482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 250/477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:06 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:06.391166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:06.391166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:06.391166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:06.391519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:06.392412 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:06.393111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:06.393592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:06.394015 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:06.484983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:06.494301 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6c58a33b-dd41-4d9d-89fa-10c8ecf1cd74 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1300 microversion: 2.1 time: 0.114716 Aug 24 17:29:06.494937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 251/478] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:06 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:06.740401 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:29:06.746014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:29:06.746014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:29:06.746014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:29:06.746014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:29:06.752601 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:06.753083 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:06.753521 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:06.754399 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:06.755298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:06.755298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:06.775329 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Getting quotas for project cf9b8b1e5c0f4021ae5f40c11c962222. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:29:06.780231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Getting quotas for user 0696e6f707274727b57a9a7493c47664 and project cf9b8b1e5c0f4021ae5f40c11c962222. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:29:06.793915 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:29:06.796494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:29:06.970989 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f426401-a63e-4607-a0a2-9cd9928eb868 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.908983 Aug 24 17:29:06.971762 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 228/479] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:29:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:29:06.979886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:06.982421 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:06.986875 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:06.987495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:06.987847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:06.988562 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:06.989015 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:06.989440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:06.994992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3fc4a21-10ef-4ce0-876b-a8f588c41457 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:06.996060 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b3fc4a21-10ef-4ce0-876b-a8f588c41457 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:06.999279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:07.099447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b3fc4a21-10ef-4ce0-876b-a8f588c41457 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:07.110303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b3fc4a21-10ef-4ce0-876b-a8f588c41457 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1246 microversion: 2.1 time: 0.123552 Aug 24 17:29:07.111185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 229/480] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:06 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:07.196681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:07.208792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d898e438-3d2b-4d06-9959-510155c75393 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.235552 Aug 24 17:29:07.209544 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 252/481] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:06 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:07.400533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:07.401158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:07.407765 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:07.411443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:07.411443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:07.411443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:07.411443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:07.412078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:07.515119 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:07.516007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:07.522578 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:07.523132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:07.523567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:07.524357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:07.524740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:07.525170 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:07.645523 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:07.654610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:07.661058 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-aef1001d-741c-456e-894a-b7a8d2979e81 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1300 microversion: 2.1 time: 0.149555 Aug 24 17:29:07.662101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 253/482] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:07 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:07.666848 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d5ed364-af6d-4ad4-9a0b-8af47ab254c8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1504 microversion: 2.1 time: 0.271228 Aug 24 17:29:07.667476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 230/483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:07 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:08.131112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:08.131721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:08.138341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:08.138827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:08.139294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:08.140028 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:08.140480 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:08.140898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:08.213767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:08.222376 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9c6cef00-657c-40ee-be2d-0155ccb570ff tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1250 microversion: 2.1 time: 0.095303 Aug 24 17:29:08.222996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 254/484] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:08 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1250 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:08.230445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:08.231309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:08.238689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:08.239220 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:08.239663 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:08.240382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:08.240844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:08.241274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:08.399305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:08.412448 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5fa17b64-c3c2-4785-8fe5-88f5a0bff591 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.186215 Aug 24 17:29:08.414031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 231/485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:08 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:08.689598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:08.690355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:08.696413 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:08.697458 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:08.698867 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:08.699569 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:08.699569 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:08.699569 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:08.701470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:08.701720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:08.708261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:08.709176 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:08.709989 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:08.711909 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:08.712807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:08.713493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:08.810186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:08.818509 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ccadefc2-9841-4a51-9284-91fcdde0b2f3 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1300 microversion: 2.1 time: 0.129817 Aug 24 17:29:08.819130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 232/486] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:08 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:08.886066 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:08.894564 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-71489ec3-92e6-4ef6-b0d0-51345e0694b8 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1504 microversion: 2.1 time: 0.209441 Aug 24 17:29:08.895167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 255/487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:08 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:09.248460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:09.248460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:09.256129 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:09.256620 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:09.257058 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:09.257763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:09.258219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:09.259255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:09.332764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:09.341218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d55322d5-7ddf-4908-a662-548b763983af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1250 microversion: 2.1 time: 0.096938 Aug 24 17:29:09.341787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 233/488] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:09 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:09.435407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:09.436041 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:09.442022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:09.442537 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:09.442988 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:09.443666 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:09.444114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:09.444534 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:09.589867 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:09.602398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5d0d338e-dcd2-4db8-90c4-08f5a43c3da3 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.170724 Aug 24 17:29:09.603082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 256/489] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:09 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:09.840336 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:09.840858 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:09.846926 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:09.847518 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:09.847966 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:09.848656 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:09.849116 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:09.849541 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:09.916065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:09.917125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:09.923986 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:09.932578 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:09.933524 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:09.934368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:09.935712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:09.936636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:09.937446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:09.951776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6e0f41ed-770e-4f14-a965-923749f60d06 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1300 microversion: 2.1 time: 0.115320 Aug 24 17:29:09.959872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 234/490] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:09 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1300 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:10.100377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:10.109392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-75df27ba-9520-4aef-b748-7458db459177 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1504 microversion: 2.1 time: 0.197894 Aug 24 17:29:10.109970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 257/491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:09 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:10.372568 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:10.373161 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:10.380198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:10.380696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:10.381141 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:10.381859 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:10.382319 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:10.382745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:10.453234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:10.461862 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc64792e-a405-41d1-a218-56da9f10a64d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1250 microversion: 2.1 time: 0.093301 Aug 24 17:29:10.462456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 235/492] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:10 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1250 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:10.627164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:10.628113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:10.634870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:10.635393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:10.635868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:10.636560 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:10.637014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:10.637430 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:10.802564 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:10.811022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-54977c4d-4ebd-4fa4-9545-28bd8dc64b75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.190890 Aug 24 17:29:10.811621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 258/493] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:10 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:10.975246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:10.976279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:10.986156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:10.986933 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:10.987652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:10.988536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:10.989410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:10.989533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:11.010421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:11.033810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:11.034393 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:11.034984 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:11.035546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lazy-loading 'fault' on Instance uuid d9783578-c61c-4c20-b25a-ffcd8257be4d {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:11.087815 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:11.095764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb4b7597-3eae-48a9-906e-765ce0c6ff33 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1305 microversion: 2.1 time: 0.127259 Aug 24 17:29:11.096348 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 236/494] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:10 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:11.137634 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:11.138240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:11.144937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:11.145420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:11.145853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:11.146545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:11.147042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:11.147511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:11.167571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:11.324194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:11.334320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2ffc0e8f-5053-4295-a2eb-44930ceaebaa tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1504 microversion: 2.1 time: 0.200177 Aug 24 17:29:11.335187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 259/495] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:11 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:11.485005 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:11.485892 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:11.496732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:11.496732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:11.496732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:11.496732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:11.497471 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:11.497471 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:11.564852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:11.573125 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-33425c27-4bf8-42ad-8ad5-52b0b41633a6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1242 microversion: 2.1 time: 0.092808 Aug 24 17:29:11.573714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 237/496] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:11 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:11.834452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:11.840645 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:11.841548 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:11.842053 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:11.842494 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:11.843229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:11.843687 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:11.844113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:12.023819 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:12.033312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e76a2ff9-b175-4f1b-a151-562b4f3ab810 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.202520 Aug 24 17:29:12.040482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 260/497] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:11 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:12.116894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:12.117510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:12.128719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:12.129226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:12.129663 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:12.130763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:12.131608 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:12.132375 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:12.174628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:12.175441 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:12.176192 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:12.176730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lazy-loading 'fault' on Instance uuid d9783578-c61c-4c20-b25a-ffcd8257be4d {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:12.233484 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:12.241853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-85287037-dda5-4a42-ba05-24d3a451affb tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1305 microversion: 2.1 time: 0.128780 Aug 24 17:29:12.242569 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 238/498] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:12 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:12.360923 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:12.361951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:12.371899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:12.372710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:12.373435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:12.374597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:12.375387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:12.376102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:12.541668 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:12.555286 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4f030154-06e6-4f89-8019-9556ee8c0480 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1504 microversion: 2.1 time: 0.200649 Aug 24 17:29:12.559118 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 261/499] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:12 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:12.603566 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:12.604155 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:12.614893 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:12.615416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:12.615855 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:12.616589 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:12.617105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:12.617630 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:12.689200 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:12.698992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2beb3e02-75bf-44ee-80e8-77e79a2a3d1a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1242 microversion: 2.1 time: 0.100546 Aug 24 17:29:12.699577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 239/500] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:12 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:13.056381 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:13.057126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:13.063365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:13.063866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:13.065679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:13.065679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:13.065679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:13.066006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:13.236269 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:13.245655 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1b3f9e5d-747c-4b6d-aa78-498c0b23fdcc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.193969 Aug 24 17:29:13.246242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 262/501] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:13 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:13.270388 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:13.271026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:13.278508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:13.279028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:13.279472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:13.280189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:13.280651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:13.281078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:13.318886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:13.319405 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:13.320421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:13.320887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lazy-loading 'fault' on Instance uuid d9783578-c61c-4c20-b25a-ffcd8257be4d {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:13.371765 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:13.380832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-003c4264-cb83-432e-853c-5152782644c9 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1305 microversion: 2.1 time: 0.115123 Aug 24 17:29:13.381483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 240/502] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:13 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:13.581540 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:13.582727 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:13.595212 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:13.596389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:13.597594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:13.599214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:13.599941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:13.600755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:13.721768 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:13.723265 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:13.730321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:13.730922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:13.731432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:13.732211 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:13.732757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:13.733249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:13.847255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:13.856611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90ed5c5b-e049-40c0-92ca-1a10cae7f0d7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1242 microversion: 2.1 time: 0.138664 Aug 24 17:29:13.857288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 241/503] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:13 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1242 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:13.897694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:13.910196 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-651c335d-ffd9-4157-b7c3-aa06cc2de6ff tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1504 microversion: 2.1 time: 0.336026 Aug 24 17:29:13.911326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 263/504] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:13 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:14.268307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:14.268920 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:14.276785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.282776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.282776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.282776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.282776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.283234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.331905 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-cd1311eb-a666-45f7-828e-d2114e4f6a3e req-d8f50acd-6d0f-4f57-a1c0-9b4b1ef8d03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c781d7-ae05-4262-8cd4-c20386eb5bac", "name": "network-vif-deleted", "tag": "95c98af6-52b4-408c-9c7f-9301a1f45d73"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:14.337669 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:14.343450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-cd1311eb-a666-45f7-828e-d2114e4f6a3e req-d8f50acd-6d0f-4f57-a1c0-9b4b1ef8d03b service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.347783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-cd1311eb-a666-45f7-828e-d2114e4f6a3e req-d8f50acd-6d0f-4f57-a1c0-9b4b1ef8d03b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.347783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-cd1311eb-a666-45f7-828e-d2114e4f6a3e req-d8f50acd-6d0f-4f57-a1c0-9b4b1ef8d03b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.359965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-cd1311eb-a666-45f7-828e-d2114e4f6a3e req-d8f50acd-6d0f-4f57-a1c0-9b4b1ef8d03b service nova] Creating event network-vif-deleted:95c98af6-52b4-408c-9c7f-9301a1f45d73 for instance 90c781d7-ae05-4262-8cd4-c20386eb5bac on hv-cinder-85164 Aug 24 17:29:14.365616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-cd1311eb-a666-45f7-828e-d2114e4f6a3e req-d8f50acd-6d0f-4f57-a1c0-9b4b1ef8d03b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037777 Aug 24 17:29:14.366245 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 264/505] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:29:14.403065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:14.403684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:14.410728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.411266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.411707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.412428 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.412891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.413959 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.446404 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:14.448785 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.449280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.449720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.450237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lazy-loading 'fault' on Instance uuid d9783578-c61c-4c20-b25a-ffcd8257be4d {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:14.454947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4e9fe694-21aa-4148-bdad-05e16fe633ea tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.191660 Aug 24 17:29:14.455808 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 242/506] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:14 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:14.498028 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:14.507333 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bf7395df-dac8-4375-9690-97cb810d4231 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1305 microversion: 2.1 time: 0.108653 Aug 24 17:29:14.508133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 265/507] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:14 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:14.877870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:14.878549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:14.885787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.886284 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.886730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.887470 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.887930 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.888364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.935375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:14.936006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:14.942455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.942987 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.943434 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.944154 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:14.945209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:14.945647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:14.956380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:14.967174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fed2af8b-ebba-445c-b070-1807b1f5e685 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1298 microversion: 2.1 time: 0.093172 Aug 24 17:29:14.968055 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 243/508] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:14 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:15.009130 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:15.017623 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-583e77b8-8642-48d7-b245-643249adc2fd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1462 microversion: 2.1 time: 0.088374 Aug 24 17:29:15.018210 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 266/509] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:14 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:15.477120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:15.477651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:15.484028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:15.484519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:15.484951 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:15.485655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:15.486104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:15.486527 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:15.532849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:15.534030 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:15.541725 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:15.542576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:15.542858 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:15.544007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:15.544640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:15.545328 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:15.597877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:15.598690 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:15.599461 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:15.600565 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lazy-loading 'fault' on Instance uuid d9783578-c61c-4c20-b25a-ffcd8257be4d {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:15.648451 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:15.660347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eba80c3a-d82a-434b-a31f-72b22e97aa39 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.187173 Aug 24 17:29:15.661187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 244/510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:15 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:15.667815 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:15.680934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a6d167ae-a0ee-4aad-8998-307b206af460 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1305 microversion: 2.1 time: 0.155341 Aug 24 17:29:15.682054 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 267/511] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:15 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1305 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:15.994703 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:15.996010 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:16.002787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:16.003339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:16.003792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:16.004544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:16.005042 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:16.005478 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:16.049691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:16.050442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:16.057714 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:16.058316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:16.058835 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:16.059652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:16.060193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:16.060704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:16.076844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:16.086013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c505fb3d-5fae-4c3d-bb38-4ef1c49081da tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1298 microversion: 2.1 time: 0.095685 Aug 24 17:29:16.086780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 245/512] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:15 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:16.127152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:16.136657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-25d44f92-f475-4aad-afb1-e8758cf5a9dd tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1462 microversion: 2.1 time: 0.095632 Aug 24 17:29:16.136657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 268/513] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:16 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1462 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:16.682086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:16.682836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:16.690335 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:16.690842 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:16.691326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:16.692126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:16.692605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:16.699425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:16.705546 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:16.706259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:16.713533 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:16.714090 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:16.714529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:16.715279 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:16.715782 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:16.716213 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:16.751200 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:16.751701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:16.752168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:16.752837 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lazy-loading 'fault' on Instance uuid d9783578-c61c-4c20-b25a-ffcd8257be4d {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:16.762579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:16.815119 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:16.825357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-55749b01-489b-4398-983b-c04c33573a5a tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1305 microversion: 2.1 time: 0.123992 Aug 24 17:29:16.826190 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 269/514] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:16 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:16.862224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:16.871496 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-87f0c311-8a9b-49c9-8306-491fe0325f75 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.193233 Aug 24 17:29:16.872203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 246/515] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:16 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:17.107869 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:17.108491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:17.115003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:17.115507 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:17.115944 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:17.116722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:17.117183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:17.117608 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:17.155047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:17.159046 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:17.159658 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:17.174118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:17.174118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:17.174118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:17.174118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:17.174532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:17.174532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:17.198138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:17.211483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d1c06047-46d3-4438-bb6f-42db0bcacf0c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1298 microversion: 2.1 time: 0.107044 Aug 24 17:29:17.212382 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 270/516] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:17 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:17.254353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:17.263735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b15e7b55-d6a5-48ea-98ba-38ba0383c843 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1462 microversion: 2.1 time: 0.109698 Aug 24 17:29:17.264436 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 247/517] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:17 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1462 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:17.853055 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:17.854007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:17.860495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:17.860974 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:17.861406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:17.862092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:17.862590 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:17.863033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:17.892947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:17.893669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:17.894337 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:17.894936 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:17.895286 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:17.895725 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lazy-loading 'fault' on Instance uuid d9783578-c61c-4c20-b25a-ffcd8257be4d {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:17.900436 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:17.900929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:17.901368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:17.902099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:17.902553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:17.903004 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:17.939914 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:17.948541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-98b587df-1bba-4b83-92d4-5d835db4eef7 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1305 microversion: 2.1 time: 0.099736 Aug 24 17:29:17.949125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 271/518] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:17 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:18.047953 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:18.056399 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f07e58d9-e7a1-408e-a44c-87d5bc4cc71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.167514 Aug 24 17:29:18.057103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 248/519] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:17 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:18.237164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:18.237914 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:18.248648 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:18.249513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:18.250247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:18.251870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:18.252542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:18.253225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:18.285184 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:18.287472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:18.293468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:18.294159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:18.294777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:18.295708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:18.296169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:18.296603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:18.351501 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:18.360423 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-060a32c2-bca3-49dd-a87b-5824f37702fb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1298 microversion: 2.1 time: 0.130751 Aug 24 17:29:18.361017 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 272/520] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:18 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1298 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:18.383287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:18.391394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7e914463-05d9-4ece-96bb-7e2f9ab2bd4c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1299 microversion: 2.1 time: 0.110079 Aug 24 17:29:18.392482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 249/521] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:18 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:18.970441 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:18.971201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:18.977751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:18.978277 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:18.978717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:18.979444 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:18.979907 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:18.980342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:19.016000 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:19.016497 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:19.016940 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:19.017665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lazy-loading 'fault' on Instance uuid d9783578-c61c-4c20-b25a-ffcd8257be4d {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:19.075931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:19.081669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:19.082598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:19.091132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:19.092099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:19.092606 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:19.093380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:19.093914 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:19.094417 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:19.095225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5def5fdb-c80d-47b8-a86b-a22b6c2fcd42 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1305 microversion: 2.1 time: 0.129420 Aug 24 17:29:19.096778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 273/522] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:18 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:19.283691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:19.297740 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73431c0d-82d3-41e1-ac33-83dc3b65599f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.223621 Aug 24 17:29:19.298454 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 250/523] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:19 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:19.382621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:19.383418 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:19.390133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:19.390652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:19.391132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:19.391837 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:19.392555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:19.392981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:19.412972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:19.415277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:19.423224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:19.423224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:19.423224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:19.423840 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:19.424165 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:19.424894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:19.465440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:19.465571 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:19.466008 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:19.466477 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lazy-loading 'fault' on Instance uuid 90c781d7-ae05-4262-8cd4-c20386eb5bac {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:19.469006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:19.483095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-38c580f7-2c06-4308-925f-d79392a80542 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1298 microversion: 2.1 time: 0.104081 Aug 24 17:29:19.484051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 274/524] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:19 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:19.510171 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:19.513130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:19.523582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a946072c-ef74-4584-b6fe-c2276f9e35ca tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1304 microversion: 2.1 time: 0.114499 Aug 24 17:29:19.528689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 251/525] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:19 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:20.133377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:20.134324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:20.145227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.145748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.146419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.147477 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.148830 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.149576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.156375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:20.191934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.192421 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.192858 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.193310 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lazy-loading 'fault' on Instance uuid d9783578-c61c-4c20-b25a-ffcd8257be4d {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:20.244797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e40c080ddcf34210bcf1a75215ee1e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1ad2d3babc4f32af3f30a3dda9dd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:20.255638 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-383067af-4311-4aef-886a-e00b32d27b1e tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 200 len: 1305 microversion: 2.1 time: 0.128981 Aug 24 17:29:20.256231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 275/526] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:20 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:20.320667 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:20.321300 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:20.328322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.328808 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.329243 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.329991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.330445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.330871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.488156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:20.497130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-985d94ae-9499-4dec-8cba-355857e64083 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.181629 Aug 24 17:29:20.497706 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 252/527] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:20 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:20.504414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:20.505050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:20.512755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.514161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.514161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.514438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.515304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.515565 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.549277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:20.550065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:20.557536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.558129 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.558636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.559437 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.559957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.560458 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.594584 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:20.595113 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:20.595546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:20.595998 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lazy-loading 'fault' on Instance uuid 90c781d7-ae05-4262-8cd4-c20386eb5bac {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:20.603128 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:20.611385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1460dc64-8294-48a2-9f2f-19afc7021d0f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1306 microversion: 2.1 time: 0.110646 Aug 24 17:29:20.611969 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 276/528] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:20 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1306 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:20.644651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:20.654136 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0c4d9893-221c-4cfb-a785-d76d8c970454 tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1304 microversion: 2.1 time: 0.108836 Aug 24 17:29:20.655086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 253/529] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:20 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:21.283860 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:21.284854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] [instance: d9783578-c61c-4c20-b25a-ffcd8257be4d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:21.292644 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:21.293126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:21.293557 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:21.294259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:21.294704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:21.295198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:21.315979 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] HTTP exception thrown: Instance d9783578-c61c-4c20-b25a-ffcd8257be4d could not be found. Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Request method failure captured: Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d HTTP/1.1 Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl-nbyGGdyjbaZQR7VVwsGj1mKI1T3V7QLf7IR-cIWZgqywsVHT8lw5Nt4nvkCo0B0rqhDL-uGwmJalJZTayUjWGeflGslQMzgnhCC_L7tP_u3zj6arMLw_oXMcobF7pSh4TRZCElr9RYEgfec6E6fxrDLuqMiAoO32rippgXskdrCk Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: de1ad2d3babc4f32af3f30a3dda9dd48 Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-VolumesNegativeTest-1078510074 Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:29:21.317791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/de1ad2d3babc4f32af3f30a3dda9dd48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/de1ad2d3babc4f32af3f30a3dda9dd48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_de1ad2d3babc4f32af3f30a3dda9dd48", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/de1ad2d3babc4f32af3f30a3dda9dd48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-VolumesNegativeTest-1078510074 Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: de1ad2d3babc4f32af3f30a3dda9dd48 Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-VolumesNegativeTest-1078510074 Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-VolumesNegativeTest-1078510074-project Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: e40c080ddcf34210bcf1a75215ee1e43 Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-VolumesNegativeTest-1078510074-project Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance d9783578-c61c-4c20-b25a-ffcd8257be4d could not be found. Aug 24 17:29:21.327487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': 'd9783578-c61c-4c20-b25a-ffcd8257be4d'} Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9783578-c61c-4c20-b25a-ffcd8257be4d could not be found. Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:29:21.329022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9783578-c61c-4c20-b25a-ffcd8257be4d could not be found. Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9783578-c61c-4c20-b25a-ffcd8257be4d could not be found. Aug 24 17:29:21.331173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:29:21.333070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] Returning 404 to user: Instance d9783578-c61c-4c20-b25a-ffcd8257be4d could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:29:21.333070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f61dc1d2-88b5-46df-a8c5-01fbda58a166 tempest-VolumesNegativeTest-1078510074 tempest-VolumesNegativeTest-1078510074-project] 10.222.0.18 "GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d" status: 404 len: 111 microversion: 2.1 time: 0.040948 Aug 24 17:29:21.333070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 277/530] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:21 2022] GET /compute/v2.1/servers/d9783578-c61c-4c20-b25a-ffcd8257be4d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:29:21.518498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:21.519743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:21.527920 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:21.528420 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:21.528870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:21.529588 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:21.530058 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:21.530518 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:21.634628 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:21.635490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:21.641961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:21.642721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:21.643235 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:21.644498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:21.644965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:21.645599 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:21.765686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:21.788752 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-47cbcd8b-5bb9-465b-93c0-118478d1369a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1316 microversion: 2.1 time: 0.158933 Aug 24 17:29:21.789374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 278/531] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:21 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:21.797177 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:21.797801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:21.805667 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:21.806182 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:21.806625 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:21.807435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:21.807893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:21.808484 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:21.817451 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:21.829440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-df9ba4b4-2514-422e-9ad2-8d6f4a54e318 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.315224 Aug 24 17:29:21.832715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 254/532] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:21 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:21.858172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:21.859056 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:21.859838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:21.860312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lazy-loading 'fault' on Instance uuid 90c781d7-ae05-4262-8cd4-c20386eb5bac {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:29:21.908399 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64eaec18a9d94723b541497bb5e1c105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0fed6b580c40509ff6514dcd82f4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:21.917438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b76854fc-96b3-4799-8f1b-c061f1d5660c tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 200 len: 1304 microversion: 2.1 time: 0.126713 Aug 24 17:29:21.921474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 279/533] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:21 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:22.822746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:22.823536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:22.830449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:22.830982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:22.831435 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:22.832155 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:22.832609 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:22.833039 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:22.862041 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:22.862765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:22.872626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:22.873766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:22.874960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:22.876622 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:22.877640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:22.878979 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:23.525534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:23.535643 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a3939c1-aaa9-442d-8bea-16d24781a19a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.718805 Aug 24 17:29:23.536415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 255/534] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:22 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:23.555734 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:23.556823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] [instance: 90c781d7-ae05-4262-8cd4-c20386eb5bac] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:23.565998 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:23.570236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:23.570236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:23.570236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:23.570236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:23.570645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:23.594397 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] HTTP exception thrown: Instance 90c781d7-ae05-4262-8cd4-c20386eb5bac could not be found. Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Request method failure captured: Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac HTTP/1.1 Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl-C5-R_Gy5cH2IaZ34Xcb5Sstch200AyTdFQ81sgpSKAICb58ZqBzN5YsYCRWwF1SKOjNAGPEVjde9z1lAzk57M111J8JMpmu3WCQTfYgm613nj-647bXdxeiY0YBC29Su3A98DDcaqqpNq89gT64kxAqAE7IAbwGEhD3gMloOs0gw Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: cc0fed6b580c40509ff6514dcd82f4dd Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesActionsTest-171377486 Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:29:23.596310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cc0fed6b580c40509ff6514dcd82f4dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cc0fed6b580c40509ff6514dcd82f4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cc0fed6b580c40509ff6514dcd82f4dd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cc0fed6b580c40509ff6514dcd82f4dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-VolumesActionsTest-171377486 Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: cc0fed6b580c40509ff6514dcd82f4dd Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesActionsTest-171377486 Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-VolumesActionsTest-171377486-project Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 64eaec18a9d94723b541497bb5e1c105 Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-VolumesActionsTest-171377486-project Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 90c781d7-ae05-4262-8cd4-c20386eb5bac could not be found. Aug 24 17:29:23.609066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '90c781d7-ae05-4262-8cd4-c20386eb5bac'} Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c781d7-ae05-4262-8cd4-c20386eb5bac could not be found. Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:29:23.609900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c781d7-ae05-4262-8cd4-c20386eb5bac could not be found. Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c781d7-ae05-4262-8cd4-c20386eb5bac could not be found. Aug 24 17:29:23.611602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:29:23.612924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] Returning 404 to user: Instance 90c781d7-ae05-4262-8cd4-c20386eb5bac could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:29:23.612924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1c722ba9-a4b0-4266-b0ed-23d29c6f0b9f tempest-VolumesActionsTest-171377486 tempest-VolumesActionsTest-171377486-project] 10.222.0.18 "GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac" status: 404 len: 111 microversion: 2.1 time: 0.052313 Aug 24 17:29:23.612924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 256/535] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:23 2022] GET /compute/v2.1/servers/90c781d7-ae05-4262-8cd4-c20386eb5bac => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:29:23.640252 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:23.667310 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-48b8f627-c8ce-4d9e-8f43-0d086652663b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.806524 Aug 24 17:29:23.672584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 280/536] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:22 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:23.814091 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b018ccb1-eda1-46fc-ac50-f0e3e464cd6d req-36f2ad7b-f6bb-482b-8735-3c2f9c1fc61a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028a50e6-e905-4cc5-aaab-ad1dfe279845", "name": "network-vif-plugged", "status": "completed", "tag": "5c495910-bb43-41b8-bcdc-3755a81d9cc7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:23.825263 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b018ccb1-eda1-46fc-ac50-f0e3e464cd6d req-36f2ad7b-f6bb-482b-8735-3c2f9c1fc61a service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:23.826445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b018ccb1-eda1-46fc-ac50-f0e3e464cd6d req-36f2ad7b-f6bb-482b-8735-3c2f9c1fc61a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:23.827098 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b018ccb1-eda1-46fc-ac50-f0e3e464cd6d req-36f2ad7b-f6bb-482b-8735-3c2f9c1fc61a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:23.843006 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b018ccb1-eda1-46fc-ac50-f0e3e464cd6d req-36f2ad7b-f6bb-482b-8735-3c2f9c1fc61a service nova] Creating event network-vif-plugged:5c495910-bb43-41b8-bcdc-3755a81d9cc7 for instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 on hv-cinder-85164 Aug 24 17:29:23.853373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b018ccb1-eda1-46fc-ac50-f0e3e464cd6d req-36f2ad7b-f6bb-482b-8735-3c2f9c1fc61a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043518 Aug 24 17:29:23.856118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 257/537] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:29:24.540843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-d9512450-0025-4eab-b8a3-6bda7b717d41 req-078f9b6b-37a0-4c10-ac5a-ad40cb89ef40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7feb685-67d6-4b7e-be2b-3e07e65391fb", "tag": "67636d15-fa82-4271-bc02-ed3ff53fee97"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:24.561010 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:24.563463 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:24.566523 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-d9512450-0025-4eab-b8a3-6bda7b717d41 req-078f9b6b-37a0-4c10-ac5a-ad40cb89ef40 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:24.567041 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-d9512450-0025-4eab-b8a3-6bda7b717d41 req-078f9b6b-37a0-4c10-ac5a-ad40cb89ef40 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:24.567482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-d9512450-0025-4eab-b8a3-6bda7b717d41 req-078f9b6b-37a0-4c10-ac5a-ad40cb89ef40 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:24.586274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:24.587803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:24.589000 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:24.591623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:24.592718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:24.593052 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-d9512450-0025-4eab-b8a3-6bda7b717d41 req-078f9b6b-37a0-4c10-ac5a-ad40cb89ef40 service nova] Creating event network-changed:67636d15-fa82-4271-bc02-ed3ff53fee97 for instance d7feb685-67d6-4b7e-be2b-3e07e65391fb on hv-cinder-85164 Aug 24 17:29:24.593572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:24.599424 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-d9512450-0025-4eab-b8a3-6bda7b717d41 req-078f9b6b-37a0-4c10-ac5a-ad40cb89ef40 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068695 Aug 24 17:29:24.601174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 281/538] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:29:24.694468 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:24.695325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:24.702828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:24.703471 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:24.703917 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:24.704637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:24.705095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:24.705522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:24.831623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:24.847294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3649ca8f-b113-439e-8a75-d2e3daa13622 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.291972 Aug 24 17:29:24.848525 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 258/539] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:24 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:24.909258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:24.919207 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8146c642-21f0-4206-b2a3-ce2e2094058d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.229201 Aug 24 17:29:24.919796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 282/540] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:24 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:25.877915 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:25.878683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:25.891686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:25.892453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:25.892911 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:25.893691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:25.894157 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:25.894589 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:25.945909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:25.948135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:25.955236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:25.956077 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:25.956516 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:25.957432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:25.957892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:25.958436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:26.128967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:26.142504 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57a9b66f-3f53-41fe-b718-01894ab5e550 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.268229 Aug 24 17:29:26.143467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 259/541] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:25 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:26.168357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:26.179872 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cef2d05e-8ded-4060-9441-bb28e20f8874 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.241106 Aug 24 17:29:26.180920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 283/542] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:25 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:27.181460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:27.186453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:27.208564 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:27.209596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:27.223530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:27.224413 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:27.225216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:27.226328 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:27.226945 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:27.227511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:27.234570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:27.235149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:27.235606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:27.236324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:27.236784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:27.237221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:27.482100 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:27.487534 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:27.491672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-78b74fb3-9719-4659-b056-82dbf8010699 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.319123 Aug 24 17:29:27.495189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 260/543] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:27 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:27.503140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8979e4ad-fe5d-4ef7-b9f2-52867c91a758 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.299277 Aug 24 17:29:27.503795 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 284/544] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:27 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:28.513186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:28.513776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:28.520914 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:28.521404 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:28.521846 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:28.523260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:28.523718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:28.524280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:28.533087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:28.534126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:28.554280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:28.557832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:28.558850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:28.559981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:28.560699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:28.561344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:28.728807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:28.736884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e4eb0d5-e39e-4e5e-b9ac-41c9f2dd96d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.227462 Aug 24 17:29:28.737500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 261/545] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:28 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:28.754889 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:28.762296 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c06d4561-eeaf-420c-a4c1-39ba7d2d4d03 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.236353 Aug 24 17:29:28.762879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 285/546] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:28 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:29.758177 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:29.758796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:29.765614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:29.766280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:29.766728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:29.767763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:29.768220 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:29.768647 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:29.788367 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:29.790022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:29.801224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:29.802409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:29.803373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:29.804327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:29.805081 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:29.805781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:29.974719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:29.982840 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8eb8cafc-83b4-40b6-b7a1-1fbc14f42787 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.228958 Aug 24 17:29:29.983644 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 262/547] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:29 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:30.008158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:30.017797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a4a08ae7-66bc-4f8d-bc54-96d645a9724d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.236759 Aug 24 17:29:30.019149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 286/548] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:29 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:31.006233 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:31.006976 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:31.014638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:31.015154 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:31.015591 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:31.016466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:31.016918 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:31.017637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:31.040188 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:31.041024 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:31.048626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:31.049295 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:31.049898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:31.050829 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:31.051624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:31.053083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:31.327049 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:31.340778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:31.341383 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b9552c89-b804-40b1-91fc-8fa2cc8fe65e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.339521 Aug 24 17:29:31.342692 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 263/549] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:31 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:31.356451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e2037b57-3931-4694-95f7-c6d173c2c071 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1263 microversion: 2.1 time: 0.320912 Aug 24 17:29:31.361535 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 287/550] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:31 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1263 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:32.369730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:32.370698 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:32.378221 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:32.379037 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:32.379454 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:32.380322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:32.380946 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:32.381363 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:32.383858 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:32.384909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:32.408691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:32.408691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:32.408691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:32.408691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:32.409051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:32.409051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:32.669460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:32.677204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-678fb1e4-9b21-4f7b-92f7-05235a32c13f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.313095 Aug 24 17:29:32.677788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 264/551] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:32 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:32.679446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:32.687891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-69e4e364-8945-4220-b96f-5f0efdb6e013 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1450 microversion: 2.1 time: 0.310511 Aug 24 17:29:32.688963 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 288/552] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:32 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1450 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:32.713242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:32.713852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:32.720037 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:32.720523 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:32.720957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:32.721649 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:32.722101 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:32.722530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:32.894758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:32.909776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-632347ee-d98b-4ecd-b178-077a765512d9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1450 microversion: 2.1 time: 0.200885 Aug 24 17:29:32.910727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 265/553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:32 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1450 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:33.703122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:33.704492 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:33.737873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:33.738605 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:33.743299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:33.745034 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:33.746542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:33.747783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:34.305118 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:34.322515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e7443a29-86f0-4b94-8bd0-4f120db70386 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.627012 Aug 24 17:29:34.327597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 289/554] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:33 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:35.368774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:35.371420 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:35.405698 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:35.409438 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:35.411713 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:35.413334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:35.417475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:35.419198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:35.742922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:35.753572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-482d5670-c38f-4ea3-b188-dcd65f8f2bcd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.393455 Aug 24 17:29:35.754164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 266/555] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:35 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:36.775910 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:36.776532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:36.786573 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:36.787113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:36.787604 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:36.794037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:36.794816 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:36.795464 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:36.844092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-bbb48ac7-f3d5-4df9-9eab-bc23329f847a req-5beddfc1-25a9-460a-92eb-9459c60e16b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028a50e6-e905-4cc5-aaab-ad1dfe279845", "tag": "5c495910-bb43-41b8-bcdc-3755a81d9cc7"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:36.879988 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bbb48ac7-f3d5-4df9-9eab-bc23329f847a req-5beddfc1-25a9-460a-92eb-9459c60e16b7 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:36.880736 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bbb48ac7-f3d5-4df9-9eab-bc23329f847a req-5beddfc1-25a9-460a-92eb-9459c60e16b7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:36.881427 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bbb48ac7-f3d5-4df9-9eab-bc23329f847a req-5beddfc1-25a9-460a-92eb-9459c60e16b7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:36.898280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-bbb48ac7-f3d5-4df9-9eab-bc23329f847a req-5beddfc1-25a9-460a-92eb-9459c60e16b7 service nova] Creating event network-changed:5c495910-bb43-41b8-bcdc-3755a81d9cc7 for instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 on hv-cinder-85164 Aug 24 17:29:36.916960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-bbb48ac7-f3d5-4df9-9eab-bc23329f847a req-5beddfc1-25a9-460a-92eb-9459c60e16b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077258 Aug 24 17:29:36.922442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 267/556] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:29:37.177953 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:37.197332 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-03d37e6a-dfdf-43de-84ee-74176e9c61db tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.425963 Aug 24 17:29:37.198723 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 290/557] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:36 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:38.236690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:38.242105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:38.267592 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=90 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:38.278623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:38.281221 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:38.283376 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:38.284308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:38.289397 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:38.289397 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:38.532910 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:38.562636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f145566b-51e3-4076-bd9a-d1d095050065 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.340445 Aug 24 17:29:38.564217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 268/558] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:38 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:39.601999 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:39.605430 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:39.630166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:39.641073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:39.641073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:39.641073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:39.641073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:39.641776 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:40.021590 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:40.039577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-33595649-961c-41c4-94ca-8b88774255ee tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.446102 Aug 24 17:29:40.055443 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 291/559] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:39 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:40.833099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2a35d49-e99e-4a46-ae48-462a6645421d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:40.836242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e2a35d49-e99e-4a46-ae48-462a6645421d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:40.862623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2a35d49-e99e-4a46-ae48-462a6645421d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:40.863429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2a35d49-e99e-4a46-ae48-462a6645421d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:40.871613 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2a35d49-e99e-4a46-ae48-462a6645421d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:40.873333 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2a35d49-e99e-4a46-ae48-462a6645421d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:40.873948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2a35d49-e99e-4a46-ae48-462a6645421d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:40.874702 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2a35d49-e99e-4a46-ae48-462a6645421d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:40.953466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e2a35d49-e99e-4a46-ae48-462a6645421d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/ips" status: 200 len: 145 microversion: 2.1 time: 0.126613 Aug 24 17:29:40.954410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 269/560] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:29:40 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/ips => generated 145 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:29:41.089984 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:41.091402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:41.110934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:41.117107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:41.122431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:41.127422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:41.128586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:41.129312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:41.306262 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:41.654694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:41.675514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c3132478-8560-49c1-b644-806097faaf96 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.610491 Aug 24 17:29:41.677401 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 292/561] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:41 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:41.717389 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b91815aa-e0ba-4877-81b2-72e086816852 req-778c802f-cded-4d3f-94b5-5bc6b7737d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7feb685-67d6-4b7e-be2b-3e07e65391fb", "name": "network-vif-plugged", "status": "completed", "tag": "67636d15-fa82-4271-bc02-ed3ff53fee97"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:41.765261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b91815aa-e0ba-4877-81b2-72e086816852 req-778c802f-cded-4d3f-94b5-5bc6b7737d1b service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:41.766239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b91815aa-e0ba-4877-81b2-72e086816852 req-778c802f-cded-4d3f-94b5-5bc6b7737d1b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:41.767020 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b91815aa-e0ba-4877-81b2-72e086816852 req-778c802f-cded-4d3f-94b5-5bc6b7737d1b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:41.837210 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b91815aa-e0ba-4877-81b2-72e086816852 req-778c802f-cded-4d3f-94b5-5bc6b7737d1b service nova] Creating event network-vif-plugged:67636d15-fa82-4271-bc02-ed3ff53fee97 for instance d7feb685-67d6-4b7e-be2b-3e07e65391fb on hv-cinder-85164 Aug 24 17:29:41.857369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b91815aa-e0ba-4877-81b2-72e086816852 req-778c802f-cded-4d3f-94b5-5bc6b7737d1b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147684 Aug 24 17:29:41.858769 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 270/562] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:29:42.700643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:42.703149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:42.714073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:42.714852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:42.715502 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:42.717120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:42.717784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:42.718368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:43.149110 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:43.172237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b4e38a59-3257-45d0-a353-5457f794610e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.476934 Aug 24 17:29:43.174344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 293/563] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:42 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:44.198087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:44.199544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:44.207208 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:44.208117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:44.208648 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:44.210216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:44.210785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:44.211479 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:44.236578 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:44.369965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:44.378674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cd0018da-c4a5-4619-b8b9-04b21b865510 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.184769 Aug 24 17:29:44.379302 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 271/564] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:44 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:45.410610 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:45.412323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:45.419752 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=74 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:45.424970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:45.425743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:45.426398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:45.455174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:45.460413 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:45.461163 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:45.714845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:45.724017 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-77224ca3-7eb2-459d-8c9e-a12554c76026 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.322226 Aug 24 17:29:45.727813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 294/565] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:45 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:46.744956 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:46.745577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:46.752369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:46.753127 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:46.753735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:46.754604 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:46.755134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:46.755560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:46.900112 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:46.908697 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-93026b7e-769b-4b23-b207-8d0106cbbccb tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.168120 Aug 24 17:29:46.909353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 272/566] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:46 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:47.928581 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:47.929327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:47.936647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:47.940827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:47.940827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:47.940827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:47.940827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:47.941337 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:48.228325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:48.245704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-313adbef-155d-4cb7-850f-2e061b41c9d4 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.320680 Aug 24 17:29:48.247714 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 295/567] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:47 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:49.279172 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:49.280709 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:49.303937 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:49.305835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:49.311424 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:49.312563 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:49.313392 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:49.315598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:49.741204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:49.752322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ca0ac3d-9ffd-4d34-b8c6-a609a70ac193 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.485786 Aug 24 17:29:49.753513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 273/568] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:49 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:50.080358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-de91c312-e805-4670-a94c-81c28822d131 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa6e4259-64e3-4edc-9b12-89cda13e6777"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:50.085276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-de91c312-e805-4670-a94c-81c28822d131 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:50.093792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de91c312-e805-4670-a94c-81c28822d131 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:50.094528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de91c312-e805-4670-a94c-81c28822d131 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:50.095365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de91c312-e805-4670-a94c-81c28822d131 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:50.101931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de91c312-e805-4670-a94c-81c28822d131 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:50.108071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de91c312-e805-4670-a94c-81c28822d131 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:50.110365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de91c312-e805-4670-a94c-81c28822d131 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:50.774893 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:50.784574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:50.805076 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:50.805889 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:50.806551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:50.820120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:50.820634 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:50.821078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:51.215247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:51.226065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50f7f392-7928-4dca-ad80-243e11b14416 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1371 microversion: 2.1 time: 0.456080 Aug 24 17:29:51.238952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 274/569] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:50 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:29:51.629681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-de91c312-e805-4670-a94c-81c28822d131 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.556866 Aug 24 17:29:51.636370 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 296/570] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:29:50 2022] POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/os-volume_attachments => generated 194 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:29:52.261393 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:52.264127 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:52.301384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:52.307493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:52.308770 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:52.312432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:52.313300 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:52.318564 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:52.660645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:29:52.679900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-77dd60f3-4519-4fdc-8beb-e6e0c87b447f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1565 microversion: 2.1 time: 0.433718 Aug 24 17:29:52.680970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 275/571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:29:52 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1565 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:29:52.725383 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0eddedba-c42b-463b-a6de-20d10089a2d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:29:52.727195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0eddedba-c42b-463b-a6de-20d10089a2d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:29:52.759693 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0eddedba-c42b-463b-a6de-20d10089a2d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:52.760929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0eddedba-c42b-463b-a6de-20d10089a2d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:52.761814 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0eddedba-c42b-463b-a6de-20d10089a2d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:52.762877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0eddedba-c42b-463b-a6de-20d10089a2d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:52.769306 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0eddedba-c42b-463b-a6de-20d10089a2d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:52.769306 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0eddedba-c42b-463b-a6de-20d10089a2d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:53.019316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0eddedba-c42b-463b-a6de-20d10089a2d9 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.303178 Aug 24 17:29:53.026088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 297/572] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 24 17:29:52 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-interface => generated 284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:29:55.230424 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-b959e521-35ab-4240-a2a2-422b5f751ba7 req-afdde060-14f4-472b-9355-9e8fc48191b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7feb685-67d6-4b7e-be2b-3e07e65391fb", "tag": "67636d15-fa82-4271-bc02-ed3ff53fee97"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:29:55.248193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b959e521-35ab-4240-a2a2-422b5f751ba7 req-afdde060-14f4-472b-9355-9e8fc48191b3 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:29:55.248634 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b959e521-35ab-4240-a2a2-422b5f751ba7 req-afdde060-14f4-472b-9355-9e8fc48191b3 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:29:55.249065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-b959e521-35ab-4240-a2a2-422b5f751ba7 req-afdde060-14f4-472b-9355-9e8fc48191b3 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:29:55.300564 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-b959e521-35ab-4240-a2a2-422b5f751ba7 req-afdde060-14f4-472b-9355-9e8fc48191b3 service nova] Creating event network-changed:67636d15-fa82-4271-bc02-ed3ff53fee97 for instance d7feb685-67d6-4b7e-be2b-3e07e65391fb on hv-cinder-85164 Aug 24 17:29:55.335541 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-b959e521-35ab-4240-a2a2-422b5f751ba7 req-afdde060-14f4-472b-9355-9e8fc48191b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097913 Aug 24 17:29:55.346878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 276/573] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:30:03.183721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=7 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:03.186136 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:03.192939 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-99564152-8150-4f32-b408-b7d84bb8cb0b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:30:03.223329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-99564152-8150-4f32-b408-b7d84bb8cb0b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:03.228012 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-99564152-8150-4f32-b408-b7d84bb8cb0b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:03.230403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-99564152-8150-4f32-b408-b7d84bb8cb0b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:03.436334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-99564152-8150-4f32-b408-b7d84bb8cb0b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Going to try to stop instance {{(pid=121011) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:30:03.702303 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-99564152-8150-4f32-b408-b7d84bb8cb0b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/action" status: 202 len: 0 microversion: 2.1 time: 0.519254 Aug 24 17:30:03.712679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 298/574] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:30:03 2022] POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:30:03.718684 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:03.725457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:03.749677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:03.756865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:03.757856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:03.759421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:03.760431 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:03.761350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:04.324821 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:04.365482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f1067ee8-7ef2-49b3-b3a1-6f6fd8ff27ce tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.649782 Aug 24 17:30:04.393126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 277/575] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:03 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:05.430665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:05.432201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:05.439227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:05.440127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:05.440686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:05.444399 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:05.445199 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:05.445839 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:05.853100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:05.867288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-497537af-7e44-4f00-a426-653837e3b6f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.441967 Aug 24 17:30:05.868460 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 299/576] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:05 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:06.893688 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:06.895818 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:06.926449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:06.928636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:06.929790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:06.932986 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:06.937295 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:06.938399 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:07.281032 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:07.298103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a08effe6-89fc-476a-91d3-10c45e8a824e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.411289 Aug 24 17:30:07.306276 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 278/577] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:06 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:08.336720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:08.338517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:08.351685 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:08.352772 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:08.355384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:08.358280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:08.361801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:08.364814 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:08.613585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:08.631432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1f7ff068-d28c-4741-836c-efca908f87b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.302477 Aug 24 17:30:08.632255 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 300/578] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:08 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:09.673739 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:09.675718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:09.699151 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:09.701669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:09.703357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:09.714004 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:09.720651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:09.721857 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:10.009527 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:10.035534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03599af5-11c9-4c76-97aa-c7e6ac996356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.368547 Aug 24 17:30:10.036653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 279/579] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:09 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:11.063757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:11.064708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:11.071356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:11.071713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:11.072272 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:11.073229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:11.073834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:11.074447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:11.275771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:11.293882 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d500cc03-8c0e-47f3-8b5b-18039e830718 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.233738 Aug 24 17:30:11.295469 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 301/580] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:11 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:12.323639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:12.331514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:12.349165 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=24 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:12.355422 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:12.359038 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:12.359870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:12.360815 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:12.365156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:12.366721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:12.681252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:12.701465 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0356d245-ddb4-493e-bf2d-8564a61b613b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.386292 Aug 24 17:30:12.702326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 280/581] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:12 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:13.730371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:13.733287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:13.748026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:13.749354 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:13.750195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:13.751642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:13.753082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:13.754670 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:14.044154 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:14.058112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-845c7a59-8796-468b-970f-0635bd30b595 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.333424 Aug 24 17:30:14.059218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 302/582] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:13 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:14.667319 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a7f5b51-d95b-41e6-8c4a-6a1a4d1ea3c9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:14.670804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a7f5b51-d95b-41e6-8c4a-6a1a4d1ea3c9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:14.681822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a7f5b51-d95b-41e6-8c4a-6a1a4d1ea3c9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:14.684888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a7f5b51-d95b-41e6-8c4a-6a1a4d1ea3c9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:14.685589 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a7f5b51-d95b-41e6-8c4a-6a1a4d1ea3c9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:14.686425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a7f5b51-d95b-41e6-8c4a-6a1a4d1ea3c9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:14.687171 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a7f5b51-d95b-41e6-8c4a-6a1a4d1ea3c9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:14.688022 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a7f5b51-d95b-41e6-8c4a-6a1a4d1ea3c9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:14.691928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=56 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:14.723870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a7f5b51-d95b-41e6-8c4a-6a1a4d1ea3c9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/ips" status: 200 len: 153 microversion: 2.20 time: 0.067197 Aug 24 17:30:14.725153 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 281/583] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Aug 24 17:30:14 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/ips => generated 153 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:30:15.095714 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:15.096380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:15.103849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:15.104332 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:15.104768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:15.105458 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:15.105908 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:15.106335 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:15.283951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:15.294498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c66f2ac3-f51f-48f2-8263-d8dfc65d05b2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.208708 Aug 24 17:30:15.298772 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 303/584] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:15 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:16.318832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:16.319964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:16.331073 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:16.331890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:16.332488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:16.333547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:16.334257 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:16.340384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:16.553972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:16.564294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-719fd097-76c8-494c-a825-5c221c12e35a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.250730 Aug 24 17:30:16.565258 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 282/585] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:16 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:16.720662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-72c9a586-4946-4bba-814a-6597d34ad142 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Action: 'create', calling method: .version_select at 0x7f3f346cf040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1875251951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxQom6k0zh8qf4Bka4FCY/OwOXzhwAJ3SfQt5elUbYmzBgfYLka8P9SV6hdQrh+/YWzFUzgCdvTECHFJiLO7dxOb5iNMRzHNIh+73wF3owpouv199xfI3T2MoJXHWVYOg=="}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:30:16.739271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-72c9a586-4946-4bba-814a-6597d34ad142 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Getting quotas for project 95cbbaf120e848a0a699fd6391aebcfd. Resources: {'key_pairs'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:30:16.744438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-72c9a586-4946-4bba-814a-6597d34ad142 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Getting quotas for user 78ce397b5ece4c5b81a1bbefcf87df9d and project 95cbbaf120e848a0a699fd6391aebcfd. Resources: {'key_pairs'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:30:16.906770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-72c9a586-4946-4bba-814a-6597d34ad142 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.191203 Aug 24 17:30:16.914288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 304/586] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:30:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:30:17.086445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-176661148", "imageRef": "88a64c37-4d6c-438c-9477-fe87778695f3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1875251951", "networks": [{"uuid": "66b44dfe-3975-4eb6-8b65-c2d64e6c80ad"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:30:17.171688 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] validate_networks() for [('66b44dfe-3975-4eb6-8b65-c2d64e6c80ad', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:30:17.603602 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:17.604940 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:17.626240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:17.637007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:17.637007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:17.639141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:17.640865 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:17.641395 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:17.820428 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:30:17.824498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:30:17.824498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:30:17.824498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:30:17.824498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:30:17.833064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:17.833559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:17.834562 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:17.835788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:17.836776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:17.837212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:17.876141 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Getting quotas for project 95cbbaf120e848a0a699fd6391aebcfd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:30:17.883082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Getting quotas for user 78ce397b5ece4c5b81a1bbefcf87df9d and project 95cbbaf120e848a0a699fd6391aebcfd. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:30:17.892447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:17.897909 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:30:17.900256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='88a64c37-4d6c-438c-9477-fe87778695f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:30:17.903488 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e8512bf8-33c4-4b0e-a802-cdb5b3ce43b1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.306916 Aug 24 17:30:17.906951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 305/587] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:17 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:18.101490 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d9816f08-a532-4a7e-b913-9ec88e483d08 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019822 Aug 24 17:30:18.102498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 283/588] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:30:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:30:18.118652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5a1915bf-c3b3-400a-9d13-85c850250dfd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:18.128166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5a1915bf-c3b3-400a-9d13-85c850250dfd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:18.246275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a1915bf-c3b3-400a-9d13-85c850250dfd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:18.261448 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5a1915bf-c3b3-400a-9d13-85c850250dfd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1258 microversion: 2.1 time: 0.149923 Aug 24 17:30:18.262129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 306/589] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:18 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:18.933285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:18.934009 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:18.941652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:18.942410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:18.943089 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:18.944099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:18.944726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:18.945515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:19.195546 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:30:19.198583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:19.211652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:19.213242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:19.214180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:19.215049 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:19.216509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:19.217315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:19.217997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:19.223010 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2dde4e64-5ac0-4c48-ab01-ed68e4253d62 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.293516 Aug 24 17:30:19.223742 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 284/590] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:18 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:19.249467 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lazy-loading 'flavor' on Instance uuid 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:30:19.296011 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-87395795-d903-499d-b78f-f07eb4968165 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:19.297439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-87395795-d903-499d-b78f-f07eb4968165 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:19.387579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-87395795-d903-499d-b78f-f07eb4968165 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:19.403593 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-87395795-d903-499d-b78f-f07eb4968165 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1258 microversion: 2.1 time: 0.114457 Aug 24 17:30:19.404569 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 285/591] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:19 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1258 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:20.086021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-aab7c28f-6f2b-4fc5-8840-c8a4bdc6d4c2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/action" status: 202 len: 0 microversion: 2.20 time: 0.900570 Aug 24 17:30:20.087187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 307/592] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 24 17:30:19 2022] POST /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/action => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:30:20.101524 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:20.102940 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:20.111697 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:20.112190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:20.112632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:20.116307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:20.116307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:20.116307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:20.255463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:20.255463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:20.269096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:20.269875 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:20.270575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:20.272331 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:20.273107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:20.273652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:20.302616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:20.312103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:20.313657 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:20.314855 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ee46b620-6cee-40db-ba9b-c7b225a8380a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.220431 Aug 24 17:30:20.315460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 286/593] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:20 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:20.435839 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:20.436959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:20.447548 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:20.448267 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:20.448795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:20.450145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:20.451013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:20.451457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:20.720722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:20.750150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1aa01c3c-19eb-47ee-978b-c70a4ad3ad3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1262 microversion: 2.1 time: 0.320700 Aug 24 17:30:20.764720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 287/594] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:20 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1262 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:20.824157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:20.837764 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5def0813-4984-4cf1-b279-d948b7904eff tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.592601 Aug 24 17:30:20.838556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 308/595] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:20 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:21.341319 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:21.342347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:21.350122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:21.350723 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:21.351254 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:21.352028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:21.352530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:21.353125 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:21.529510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:21.529770 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:21.531346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:21.532797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-115bd01e-913e-4d33-ab9e-9c9bb23a23b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.196033 Aug 24 17:30:21.533370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 288/596] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:21 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:21.781651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:21.782542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:21.790934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:21.791412 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:21.791852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:21.792844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:21.793414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:21.794003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:21.871797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:21.873289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:21.881671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:21.883371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:21.884261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:21.885400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:21.887376 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:21.888294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:21.889105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:21.894858 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f84f6b0d-7cfc-45d3-b3b2-f78e85c0c930 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1310 microversion: 2.1 time: 0.117381 Aug 24 17:30:21.897947 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 309/597] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:21 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1310 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:22.072449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:22.082306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4fb9f12a-426d-4f90-87f5-4101f95965fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.219305 Aug 24 17:30:22.082921 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 289/598] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:21 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:22.570944 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:22.571566 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:22.583166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:22.583886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:22.584503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:22.585468 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:22.586083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:22.586630 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:22.791539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:22.800899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:22.803202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:22.804420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4fcada85-f8f9-4aeb-8022-5ccef3b7a44f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.247682 Aug 24 17:30:22.805356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 310/599] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:22 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:22.926593 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:22.927986 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:22.935770 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:22.936268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:22.936953 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:22.937820 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:22.938428 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:22.939034 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:23.057655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:23.072673 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fd5529a7-f1e4-4862-8c3c-57c7f847af2f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1316 microversion: 2.1 time: 0.153170 Aug 24 17:30:23.073837 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 290/600] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:22 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:23.109648 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:23.110657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:23.121562 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:23.122208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:23.122934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:23.132579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:23.135155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:23.135155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:23.420484 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:23.429843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9d09eba9-6941-401a-a36f-fe2adf1c8ce8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.326875 Aug 24 17:30:23.430656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 311/601] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:23 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:23.831672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:23.833869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:23.843752 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:23.844699 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:23.845721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:23.847174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:23.848270 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:23.850063 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:24.105060 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:24.123135 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:24.124442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:24.125521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:24.128042 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:24.129606 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2610fab2-3467-473a-8b4b-ee76e0a580b3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.304011 Aug 24 17:30:24.131402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 291/602] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:23 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:24.139066 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:24.139066 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:24.139502 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:24.140379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:24.141075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:24.141703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:24.382026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:24.396825 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-280e0f24-78b1-4b6e-9d5e-ca4dcffb6b79 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.304075 Aug 24 17:30:24.398198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 312/603] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:24 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:24.459066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:24.459804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:24.478980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:24.483667 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:24.485193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:24.488357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:24.489218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:24.491354 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:24.802188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:24.817394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d91292c4-e8fb-4e52-8f5e-62c835bc9571 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.362559 Aug 24 17:30:24.818035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 292/604] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:24 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:25.169259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:25.170328 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:25.180198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:25.181292 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:25.182117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:25.185280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:25.185280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:25.185898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:25.221589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:25.422498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:25.423409 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:25.430539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:25.439190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:25.439630 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:25.440613 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:25.441079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:25.441686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:25.489091 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:25.508723 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:25.513408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:25.516233 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2ba4b719-1845-4374-aed9-363f9b47212c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.355592 Aug 24 17:30:25.534121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 313/605] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:25 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:25.560456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-94623031-4330-42ef-82ca-fe7de7ef9c66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:25.561331 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-94623031-4330-42ef-82ca-fe7de7ef9c66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:25.574322 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94623031-4330-42ef-82ca-fe7de7ef9c66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:25.575490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94623031-4330-42ef-82ca-fe7de7ef9c66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:25.576782 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94623031-4330-42ef-82ca-fe7de7ef9c66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:25.584787 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94623031-4330-42ef-82ca-fe7de7ef9c66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:25.585852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94623031-4330-42ef-82ca-fe7de7ef9c66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:25.586763 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94623031-4330-42ef-82ca-fe7de7ef9c66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:25.667683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-94623031-4330-42ef-82ca-fe7de7ef9c66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/ips" status: 200 len: 148 microversion: 2.1 time: 0.131365 Aug 24 17:30:25.668295 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 314/606] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:30:25 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/ips => generated 148 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:30:25.696989 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:25.719502 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d79fccc7-e11c-4def-8521-2afce0086588 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.304616 Aug 24 17:30:25.734944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 293/607] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:25 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:25.846186 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:25.847430 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:25.869098 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:25.869945 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:25.870648 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:25.871822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:25.873309 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:25.877456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:26.064162 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:26.075542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-50764b9c-0f36-43da-b44b-1a781989dc6b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.237989 Aug 24 17:30:26.076419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 315/608] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:25 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:26.558144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:26.560086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:26.566976 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:26.567545 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:26.568282 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:26.569057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:26.569462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:26.570001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:26.761386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:26.763929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:26.779050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:26.784264 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:26.784264 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:26.784264 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:26.784264 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:26.787914 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:26.796780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:26.833254 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:26.839762 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:26.845154 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eb925ba4-6b8a-4fe0-ba63-844d339ff314 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.291430 Aug 24 17:30:26.850185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 294/609] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:26 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:27.099191 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:27.100440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:27.104241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:27.115995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4b537d69-1d77-4b3a-9613-45bc90c0c047 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.359057 Aug 24 17:30:27.117301 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 316/610] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:26 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:27.121666 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:27.123094 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:27.124260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:27.126573 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:27.128106 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:27.129195 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:27.340968 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:27.404995 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12f335cd-f593-491b-98b1-c719f05c9fdd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.256410 Aug 24 17:30:27.404995 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 295/611] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:27 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:27.875980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:27.876647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:27.884536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:27.885327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:27.885766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:27.887184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:27.887674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:27.888101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:28.158528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:28.159739 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:28.162861 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:28.180742 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:28.195570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:28.195761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:28.195761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:28.195761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:28.195761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:28.196092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:28.197844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:28.201078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:28.213206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-aa35091e-352b-4325-8cc9-34b0848ed8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.333057 Aug 24 17:30:28.215572 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 317/612] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:27 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:28.377792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:28.377792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:28.385199 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=6 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:28.386878 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:28.387409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:28.389062 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:28.389792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:28.390409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:28.390957 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:28.481620 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:28.501219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-18f3a762-1eb6-429e-8f4e-01da5cf85f41 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.351902 Aug 24 17:30:28.514963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 296/613] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:28 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:28.797289 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:28.821444 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e984eb87-a81b-462b-8b44-b7dd8d6105cc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.448570 Aug 24 17:30:28.834785 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 318/614] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:28 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:29.179210 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-967d39c8-fa66-4f63-9f6f-2ccbd067ee22 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5171e24d-f578-4d15-b6fc-33f4751d450e"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:30:29.182442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-967d39c8-fa66-4f63-9f6f-2ccbd067ee22 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:29.192292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967d39c8-fa66-4f63-9f6f-2ccbd067ee22 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:29.205234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967d39c8-fa66-4f63-9f6f-2ccbd067ee22 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:29.205234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967d39c8-fa66-4f63-9f6f-2ccbd067ee22 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:29.205234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967d39c8-fa66-4f63-9f6f-2ccbd067ee22 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:29.205234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967d39c8-fa66-4f63-9f6f-2ccbd067ee22 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:29.205725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-967d39c8-fa66-4f63-9f6f-2ccbd067ee22 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:29.245450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:29.246081 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:29.256149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:29.257478 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:29.257781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:29.258988 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:29.259717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:29.260669 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:29.399422 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:29.508712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:29.530871 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:29.533285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:29.534673 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-43b8b41a-f534-4a9a-8b03-1b4968f62c17 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.294615 Aug 24 17:30:29.535828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 319/615] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:29 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:29.543894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:29.550608 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:29.551657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:29.552159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:29.552630 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:29.553508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:29.553971 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:29.554389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:29.763735 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:29.778303 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-73edb856-9995-4508-8330-1f66ab52a18d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.239058 Aug 24 17:30:29.778879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 320/616] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:29 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:29.848259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:29.848880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:29.860890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:29.861570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:29.861880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:29.862668 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:29.863147 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:29.863583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:30.097447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:30.119356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4f113172-fcac-4dac-a1d7-7def576b3a7f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.274559 Aug 24 17:30:30.120813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 321/617] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:29 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:30.574619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:30.576380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:30.591952 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:30.592460 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:30.592906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:30.593626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:30.594109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:30.594506 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:30.816594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:30.848432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:30.854294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:30.854294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b8464fa2-5bf4-4bd7-a073-81df3d77af0f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.282804 Aug 24 17:30:30.854294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 322/618] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:30 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:30.859708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:30.860439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:30.869083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:30.870060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:30.870414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:30.871104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:30.871570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:30.872000 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:31.083050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:31.107430 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fdabb1da-4d40-4f90-ad00-0f4e0ea71abc tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.247730 Aug 24 17:30:31.109103 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 323/619] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:30 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:31.158825 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:31.163071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:31.172931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:31.172931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:31.172931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:31.172931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:31.173379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:31.173379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:31.385252 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:31.398786 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6be126c9-9e00-4964-9d5a-114debdfa0d7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.244274 Aug 24 17:30:31.399969 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 324/620] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:31 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:31.881331 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:31.882351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:31.904921 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:31.906101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:31.907060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:31.908026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:31.909028 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:31.909774 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:32.154514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:32.168618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:32.170571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:32.172370 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-88d164e0-d4fb-4f68-9148-1ffd8d79ea74 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.297297 Aug 24 17:30:32.173415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 325/621] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:31 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:32.184209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:32.186804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:32.198848 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:32.200109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:32.201125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:32.202840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:32.203707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:32.204478 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:32.401573 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:32.428155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-dbd75468-7f49-4555-8f2e-b86258bdf9f9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.250526 Aug 24 17:30:32.429265 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 326/622] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:32 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:32.438229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:32.444096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:32.457094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:32.458305 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:32.459704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:32.461366 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:32.462319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:32.464450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:32.689262 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:32.704449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-43585c2d-7315-4d5e-a9c2-e9a594a9fd93 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.273575 Aug 24 17:30:32.719024 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 327/623] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:32 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:33.203840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:33.203840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:33.211978 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:33.212938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:33.213554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:33.215786 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:33.216543 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:33.217287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:33.473829 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:33.490353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:33.493320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:33.494894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-7b9196b9-97cc-4273-946a-86293ab11d27 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.300636 Aug 24 17:30:33.499394 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 328/624] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:33 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:33.511259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:33.519312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:33.522251 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:33.528613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:33.529276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:33.529799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:33.530604 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:33.531180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:33.532118 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:33.771003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:33.784643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bbbeaa3c-0dd0-4a89-b5e4-a461b7bea9d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.286874 Aug 24 17:30:33.785803 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 329/625] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:33 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:33.794932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:33.796057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:33.812568 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:33.823619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:33.823619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:33.823619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:33.823619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:33.824231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:33.853440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:34.060102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:34.072928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ec4bb498-f5af-4679-a6d6-7f19d77e7a6c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.285033 Aug 24 17:30:34.075335 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 330/626] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:33 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:34.525690 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:34.527097 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:34.544223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:34.544892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:34.545425 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:34.546567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:34.547522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:34.548290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:34.753800 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:34.771794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:34.771794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:34.771794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c2f0584a-f217-4091-b46f-16daf0760015 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.249835 Aug 24 17:30:34.772431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 331/627] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:34 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:34.824052 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:34.825291 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:34.836360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:34.856115 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:34.856115 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:34.856115 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:34.856115 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:34.856657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:35.051725 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:35.076809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3fb91645-3797-4256-95b0-ea86e55a5421 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.259294 Aug 24 17:30:35.079822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 332/628] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:34 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:35.100975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:35.101709 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:35.112630 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:35.113561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:35.114133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:35.115259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:35.115971 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:35.116564 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:35.342428 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:35.364356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4428eead-bef5-47e4-ab95-f3da5dfd0e21 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.267717 Aug 24 17:30:35.375125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 333/629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:35 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:35.803528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:35.804692 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:35.818651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:35.836449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:35.836449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:35.836449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:35.836449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:35.837085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:36.020215 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:36.035618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:36.038847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:36.041229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e802be33-c8a4-4170-8232-bbae767613fa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.246170 Aug 24 17:30:36.042262 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 334/630] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:35 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:36.113988 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:36.116456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:36.128408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:36.133731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:36.133731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:36.133731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:36.133731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:36.134473 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:36.425400 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:36.449781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-29b9d1fa-2d29-4f37-b5f7-0bff17805e8d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.340357 Aug 24 17:30:36.453253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 335/631] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:36 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:36.467616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:36.480294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:36.501015 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:36.507087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:36.507087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:36.507087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:36.507087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:36.507739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:36.756810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:36.764415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-18c41d26-7a63-4d1b-b0bb-5f5df6b41f57 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.306472 Aug 24 17:30:36.765423 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 336/632] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:36 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:37.070353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:37.071528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:37.078158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:37.078894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:37.079224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:37.079867 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:37.080327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:37.080760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:37.347698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:37.367127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:37.391415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:37.394516 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e8b7a645-3b7d-4b58-b90a-8970b5fff40c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.329516 Aug 24 17:30:37.399865 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 337/633] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:37 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:37.492686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:37.493366 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:37.503318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:37.504743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:37.506110 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:37.507942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:37.508680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:37.515186 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:37.728287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:37.742123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-49c3a675-b32c-4e93-a18f-4104e7814ba4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.254303 Aug 24 17:30:37.743212 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 338/634] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:37 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:37.792522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:37.793734 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:37.803314 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:37.806967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:37.806967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:37.806967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:37.806967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:37.807891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:38.043518 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:38.061149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-46c02943-7a19-4d04-8417-de8ef24d6f94 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.277142 Aug 24 17:30:38.062554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 339/635] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:37 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:38.430109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:38.431182 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:38.444479 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:38.445218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:38.445808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:38.451021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:38.451699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:38.452195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:38.655599 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:38.659921 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:38.661445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:38.662667 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c44f0aba-8fe8-4b3f-8bf4-fb5e1a06788f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.247607 Aug 24 17:30:38.663583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 340/636] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:38 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:38.769691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:38.770399 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:38.777613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:38.778114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:38.778554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:38.779309 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:38.779775 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:38.780201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:38.965666 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:38.989596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b7622c59-6bac-4e38-9a5e-b7384781cee3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.227339 Aug 24 17:30:39.000355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 341/637] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:38 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:39.090303 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:39.091079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:39.101833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:39.102382 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:39.104948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:39.105764 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:39.106466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:39.107123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:39.196241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:39.334598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=89 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:39.378888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:39.378888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6020b0b2-a7d3-4de4-94fb-f6c04d1f6c5e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.291259 Aug 24 17:30:39.378888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 342/638] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:39 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:39.688285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:39.689237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:39.699138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:39.701349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:39.701746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:39.702496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:39.703003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:39.703438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:39.849635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:39.858796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:39.860588 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:39.861765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6ada6f54-785d-4078-8df8-625c26cc0f7e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.179344 Aug 24 17:30:39.862559 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 343/639] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:39 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:40.022020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:40.022666 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:40.029363 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:40.029804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:40.030237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:40.031006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:40.031587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:40.032007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:40.174561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:40.183127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-68bb76d1-b417-4cfe-bf89-5fe5cea965d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.165285 Aug 24 17:30:40.183702 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 344/640] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:40 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:40.400155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:40.400769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:40.407483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:40.407997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:40.408407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:40.409106 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:40.409565 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:40.409995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:40.541848 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:40.551071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ae842a7a-6d19-4925-b606-7eadf565ca2d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.155625 Aug 24 17:30:40.551966 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 345/641] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:40 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:40.886546 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:40.887952 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:40.895180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:40.898583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:40.898583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:40.898583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:40.898583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:40.899128 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:41.041574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:41.050512 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:41.052508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:41.053762 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b4420890-7a10-4ee2-9df7-68ffa9f653c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.171352 Aug 24 17:30:41.061501 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 346/642] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:40 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:41.203886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:41.204499 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:41.210577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:41.211000 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:41.211432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:41.212106 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:41.212560 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:41.212980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:41.216854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:41.343441 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:41.351376 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3a19ba6e-cbb9-4b1b-a83b-9245617bbd91 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.151261 Aug 24 17:30:41.351979 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 347/643] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:41 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:41.571708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:41.572315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:41.578164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:41.578643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:41.579114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:41.579788 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:41.580238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:41.580659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:41.736909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:41.745812 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-168982fa-de2f-45c2-89e0-de0b598b5f29 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.178075 Aug 24 17:30:41.746381 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 348/644] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:41 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:42.078740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:42.079464 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:42.086542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:42.094600 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:42.094600 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:42.094600 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:42.094600 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:42.095072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:42.224835 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:42.233552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:42.235079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:42.236215 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-727390ba-4e14-4400-aebe-a6d47d313155 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.161441 Aug 24 17:30:42.236770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 349/645] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:42 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:42.378296 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:42.378862 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:42.385390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:42.385872 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:42.386306 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:42.387039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:42.387482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:42.387901 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:42.675684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:42.688103 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d6318b7a-eb8c-4e8b-a68f-cb563dfe1b32 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.313642 Aug 24 17:30:42.688697 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 350/646] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:42 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:42.766758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:42.767511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:42.774044 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:42.774527 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:42.774987 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:42.775670 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:42.776124 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:42.776545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:42.911235 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:42.921830 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c2df0aa8-225d-473c-81a8-69760c664324 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.158771 Aug 24 17:30:42.922496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 351/647] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:42 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:43.259621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:43.260235 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:43.267304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:43.267799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:43.268243 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:43.269218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:43.269712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:43.270195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:43.411352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:43.420280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:43.421778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:43.422945 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-57c97329-a13e-4c7c-aab3-a058a7500053 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.167672 Aug 24 17:30:43.423509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 352/648] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:43 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:43.717106 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:43.717738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:43.723732 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:43.724217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:43.724650 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:43.726351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:43.727081 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:43.730751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:43.855100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:43.862853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e24287d5-7e8b-4281-992a-5f4a21d35d4f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.149618 Aug 24 17:30:43.863442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 353/649] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:43 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:43.944425 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:43.945096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:43.951292 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:43.951808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:43.952243 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:43.952935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:43.953391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:43.953837 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:44.083848 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:44.093073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-65563ca5-9e91-4df5-9b3f-863de01fa811 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.153189 Aug 24 17:30:44.093644 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 354/650] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:43 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:44.447608 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:44.448248 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:44.454573 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:44.455080 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:44.455508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:44.456185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:44.456636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:44.457048 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:44.588228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:44.596392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:44.597894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:44.599075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f9445a6c-9f4c-4796-abeb-a9d1b266e894 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.156406 Aug 24 17:30:44.599628 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 355/651] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:44 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:44.883356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:44.884001 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:44.890305 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:44.890789 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:44.891253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:44.891939 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:44.892395 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:44.892819 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:45.034738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:45.040139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e7440e6d-78c3-45ec-950f-c35edae8565c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.160560 Aug 24 17:30:45.040643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 356/652] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:44 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:45.115395 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:45.116020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:45.122006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:45.122495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:45.122964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:45.123653 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:45.124112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:45.124537 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:45.250770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:45.259586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fdab3910-455f-4fe3-80be-b3b5e366d7b5 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.148030 Aug 24 17:30:45.260158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 357/653] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:45 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:45.623063 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:45.623746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:45.630430 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:45.630948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:45.631926 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:45.632621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:45.633103 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:45.633527 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:45.771159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:45.779625 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:45.781116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:45.782269 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b8d3acad-ce20-4c3b-8b51-bfe8ebe669f6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.163195 Aug 24 17:30:45.782855 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 358/654] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:45 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:46.060862 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:46.061473 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:46.067629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:46.068117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:46.068557 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:46.069595 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:46.070151 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:46.070576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:46.204452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:46.212255 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-38297545-b6c0-4e99-a079-00e30148eaa9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.155213 Aug 24 17:30:46.212863 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 359/655] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:46 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:46.281506 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:46.282118 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:46.288774 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:46.289263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:46.289698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:46.290390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:46.290842 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:46.291294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:46.424925 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:46.433627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-07651006-11fb-4976-9bab-25f7b4c7dc0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.155962 Aug 24 17:30:46.434185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 360/656] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:46 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:46.806246 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:46.806925 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:46.813483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:46.813969 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:46.814398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:46.815122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:46.815574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:46.816042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:46.952223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:46.960624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:46.962282 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:46.963324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-73503426-7400-40cf-a373-ab7df8afc69a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.161759 Aug 24 17:30:46.963885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 361/657] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:46 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:47.233353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:47.233966 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:47.240297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:47.240788 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:47.241225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:47.241920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:47.242373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:47.242796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:47.374677 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:47.383812 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2fcd1b57-b058-45f7-aed2-cb1a2c0b7e56 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.153483 Aug 24 17:30:47.383812 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 362/658] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:47 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:47.455672 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:47.456292 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:47.462702 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:47.463211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:47.463654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:47.464335 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:47.464792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:47.465217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:47.600005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:47.603498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:47.608455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f8eaf4eb-745c-46ec-8b18-e3ef67c14772 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.156600 Aug 24 17:30:47.609057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 363/659] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:47 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:47.987884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:47.988567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:47.996050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:47.996545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:47.996981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:47.997682 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:47.998139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:47.998565 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:48.139121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:48.147972 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:48.149471 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:48.150611 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-08ae1308-e72b-4f7b-8912-308ec233608e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.166708 Aug 24 17:30:48.151211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 364/660] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:47 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:48.403986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:48.404627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:48.411352 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:48.411836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:48.412260 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:48.413476 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:48.414039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:48.414498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:48.576765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:48.587259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b59048d0-d45d-4dc5-889d-3af06829ca81 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.186997 Aug 24 17:30:48.587886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 365/661] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:48 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:48.635641 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:48.636392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:48.642849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:48.643368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:48.644087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:48.644786 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:48.645236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:48.645685 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:48.902311 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:48.911921 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-928ade44-66a4-47d4-8c72-add6360ee35b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1724 microversion: 2.1 time: 0.280205 Aug 24 17:30:48.913196 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 366/662] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:48 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:49.175403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:49.178160 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:49.184389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:49.184913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:49.185554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:49.186290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:49.186781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:49.187262 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:49.458840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:49.467980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:49.469454 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:49.470619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8842bd93-aa74-42b3-9afe-ddc9e2c4902c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.300052 Aug 24 17:30:49.471209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 367/663] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:49 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:49.608303 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:49.609021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:49.615096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:49.616130 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:49.616563 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:49.617247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:49.617697 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:49.618116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:49.823377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:49.831874 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-86de9055-71b6-44bc-a0de-124e4a601dca tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.227452 Aug 24 17:30:49.839754 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 368/664] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:49 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:49.839754 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-c42adb34-35e9-4e2a-8307-3fd15a1ba811 req-22dc2bad-e9d9-4c16-929f-82562da81618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c94f29-0255-41b2-8d0e-9cb5b207b1c5", "tag": "c45cd91b-3f4f-4af5-bc7b-065f2fa372d1"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:30:49.846071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-c42adb34-35e9-4e2a-8307-3fd15a1ba811 req-22dc2bad-e9d9-4c16-929f-82562da81618 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:49.846542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-c42adb34-35e9-4e2a-8307-3fd15a1ba811 req-22dc2bad-e9d9-4c16-929f-82562da81618 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:49.846990 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-c42adb34-35e9-4e2a-8307-3fd15a1ba811 req-22dc2bad-e9d9-4c16-929f-82562da81618 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:49.858813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-c42adb34-35e9-4e2a-8307-3fd15a1ba811 req-22dc2bad-e9d9-4c16-929f-82562da81618 service nova] Creating event network-changed:c45cd91b-3f4f-4af5-bc7b-065f2fa372d1 for instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 on hv-cinder-85164 Aug 24 17:30:49.863871 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-c42adb34-35e9-4e2a-8307-3fd15a1ba811 req-22dc2bad-e9d9-4c16-929f-82562da81618 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030273 Aug 24 17:30:49.864502 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 369/665] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:30:49.940180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:49.941386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:49.949633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:49.950169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:49.950702 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:49.951472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:49.951978 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:49.952420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:50.173197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:50.183036 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-de49249c-1a54-4bbf-bfe8-8ea234a7c2f9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1701 microversion: 2.1 time: 0.249909 Aug 24 17:30:50.184064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 370/666] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:49 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1701 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:50.204308 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b8529c1a-b3e9-482c-a16b-6702673d5a59 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:30:50.211407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8529c1a-b3e9-482c-a16b-6702673d5a59 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:50.211892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8529c1a-b3e9-482c-a16b-6702673d5a59 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:50.212329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8529c1a-b3e9-482c-a16b-6702673d5a59 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:50.234551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-967d39c8-fa66-4f63-9f6f-2ccbd067ee22 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 21.063594 Aug 24 17:30:50.235370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 297/667] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:30:29 2022] POST /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments => generated 194 bytes in 21065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:30:50.239045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b8529c1a-b3e9-482c-a16b-6702673d5a59 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Going to try to start instance {{(pid=121011) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:30:50.495979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:50.496694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:50.503814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:50.504314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:50.504947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:50.505665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:50.518180 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:50.518180 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:50.621661 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b8529c1a-b3e9-482c-a16b-6702673d5a59 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/action" status: 202 len: 0 microversion: 2.1 time: 0.421304 Aug 24 17:30:50.622364 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 371/668] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:30:50 2022] POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:30:50.633910 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:50.635179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:50.643596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:50.644871 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:50.645520 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:50.654665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:50.655372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:50.656145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:51.043685 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:51.057291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:51.057291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:51.057736 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cc945770-434e-45f2-a17c-7ed94809ae73 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.566501 Aug 24 17:30:51.058546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 298/669] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:50 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:51.078776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:51.079146 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:51.086003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:51.086774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:51.087605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:51.088557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:51.089260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:51.090072 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:51.254662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:51.265094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4c38c27f-f9a8-42d6-abc2-dcf668d3c07d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1710 microversion: 2.1 time: 0.638006 Aug 24 17:30:51.265685 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 372/670] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:50 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1710 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:51.327499 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:51.339287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac712887-8ff4-43cd-8d57-5c72a0db29a0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.268815 Aug 24 17:30:51.353261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 299/671] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:51 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:52.082780 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:52.083415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:52.089931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:52.090419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:52.090859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:52.110197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:52.110197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:52.110197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:52.248949 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:52.254943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:52.256589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:52.257744 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-47b5a419-7ff4-46f8-8991-dcc36040b5fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.178902 Aug 24 17:30:52.258318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 373/672] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:52 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:52.286447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:52.287092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:52.294703 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:52.295327 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:52.295770 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:52.296506 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:52.296966 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:52.297394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:52.361232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:52.361838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:52.368547 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:52.369118 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:52.369474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:52.370186 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:52.370691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:52.371150 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:52.483641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:52.494567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23c62c98-d374-4af0-8e14-279cd824ec5b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1710 microversion: 2.1 time: 0.211986 Aug 24 17:30:52.495537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 300/673] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:52 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1710 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:52.542107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:52.561877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-651a308a-c8a1-4a32-865a-71cab8ead583 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.204490 Aug 24 17:30:52.562553 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 374/674] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:52 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:53.281549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:53.282182 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:53.288955 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:53.289446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:53.289921 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:53.291852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:53.292323 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:53.292816 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:53.438129 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:53.447065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:53.448563 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:53.449732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-64acefee-1e89-43ee-983c-9f14e303a123 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.172279 Aug 24 17:30:53.450311 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 301/675] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:53 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:53.516667 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:53.519347 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:53.525192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:53.525687 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:53.526124 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:53.526864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:53.527370 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:53.527798 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:53.584081 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:53.584672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:53.592441 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:53.592711 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:53.593139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:53.593846 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:53.594300 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:53.594720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:53.723965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:53.732875 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8361e4b1-61a3-438c-9072-d4a9495d0356 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1710 microversion: 2.1 time: 0.220103 Aug 24 17:30:53.733550 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 375/676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:53 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:53.772043 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:53.780460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cfbd9c94-95ef-4bd6-a8e5-b877a69bd10b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.200285 Aug 24 17:30:53.781278 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 302/677] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:53 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:53.989469 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-80f357dc-d6cf-47b3-bfea-2084415668c6 req-6940563c-7c83-4e20-8ccf-2ce067838e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5542f65d-3efd-4dc6-9c28-ea9d8ac19317", "name": "network-vif-plugged", "status": "completed", "tag": "afddf061-f22c-4311-aa82-82860263ce79"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:30:53.999781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-80f357dc-d6cf-47b3-bfea-2084415668c6 req-6940563c-7c83-4e20-8ccf-2ce067838e0b service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:54.000339 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-80f357dc-d6cf-47b3-bfea-2084415668c6 req-6940563c-7c83-4e20-8ccf-2ce067838e0b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:54.000796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-80f357dc-d6cf-47b3-bfea-2084415668c6 req-6940563c-7c83-4e20-8ccf-2ce067838e0b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:54.012865 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-80f357dc-d6cf-47b3-bfea-2084415668c6 req-6940563c-7c83-4e20-8ccf-2ce067838e0b service nova] Creating event network-vif-plugged:afddf061-f22c-4311-aa82-82860263ce79 for instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 on hv-cinder-85164 Aug 24 17:30:54.017845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-80f357dc-d6cf-47b3-bfea-2084415668c6 req-6940563c-7c83-4e20-8ccf-2ce067838e0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032488 Aug 24 17:30:54.018435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 376/678] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:30:54.473632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:54.474254 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:54.482030 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:54.482535 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:54.483016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:54.483749 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:54.484211 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:54.484647 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:54.628314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:54.637413 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:54.639067 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:54.640321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82665b84-173d-45ab-b98e-cf61f0a1fc72 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.170690 Aug 24 17:30:54.640944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 303/679] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:54 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:54.755014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:54.755619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:54.762879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:54.763413 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:54.769630 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:54.769630 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:54.769630 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:54.769630 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:54.801671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:54.802285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:54.808559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:54.809735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:54.809735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:54.810645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:54.811078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:54.811506 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:54.960720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:54.969688 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-349b019b-f914-4fe6-a7d8-f33d2ee077d4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1710 microversion: 2.1 time: 0.219530 Aug 24 17:30:54.972368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 377/680] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:54 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:54.990768 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:54.998516 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eff69b04-7549-46cd-9119-e079d874980a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.200817 Aug 24 17:30:54.999170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 304/681] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:54 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:55.664639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:55.665157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:55.672144 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:55.672652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:55.673101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:55.673823 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:55.674281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:55.674710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:55.830826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:55.840167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:55.851256 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:55.851256 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d6e7db34-4145-46d2-9a0a-3c9436edcd8c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.182402 Aug 24 17:30:55.851256 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 378/682] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:55 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:55.996059 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:55.996059 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:56.016976 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:56.018012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:56.018803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:56.020066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:56.020705 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:56.021343 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:56.030301 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:56.031310 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:56.034074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:56.040438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:56.041183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:56.041799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:56.042658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:56.043299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:56.043872 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:56.241741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:56.258177 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03297486-a7f6-470e-a2c8-52aa0aef1716 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1710 microversion: 2.1 time: 0.268319 Aug 24 17:30:56.259388 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 305/683] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:55 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1710 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:56.261522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:56.278185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a4ec5b98-8657-45ba-917a-3449fcd35dc3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.258510 Aug 24 17:30:56.279888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 379/684] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:56 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:56.869922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:56.871136 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:56.879070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:56.879580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:56.880063 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:56.880865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:56.881383 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:56.881863 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:57.041389 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:57.051376 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:57.052922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:57.054134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7062c09e-32b1-42f2-b18a-ac82eafce278 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.189263 Aug 24 17:30:57.054702 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 306/685] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:56 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:30:57.310509 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:57.311280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:57.318604 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:57.319936 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:57.320486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:57.321519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:57.322164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:57.322686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:57.447739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:57.448435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:57.455825 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:57.456364 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:57.456811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:57.457540 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:57.458245 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:57.458805 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:57.537345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:57.553212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-627c734b-73fb-4100-855b-87d94a67cc04 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.247131 Aug 24 17:30:57.554608 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 307/686] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:57 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:57.667800 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:57.671391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:30:57.679358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b8d36360-7198-4dae-9cb6-52960be3c6eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1710 microversion: 2.1 time: 0.379039 Aug 24 17:30:57.680282 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 380/687] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:57 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1710 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:58.080307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:58.080934 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:58.087867 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:58.088349 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:58.088782 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:58.089614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:58.090293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:58.090614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:58.288918 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:58.298362 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:58.300247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:58.303583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5548f174-3230-4138-8def-d49df29738e8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.225450 Aug 24 17:30:58.303583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 308/688] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:58 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:58.586752 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:58.587576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:58.595354 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:58.601211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:58.601211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:58.601211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:58.601211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:58.601779 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:58.702411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:58.703057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:58.710872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:58.711410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:58.711860 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:58.712636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:58.713067 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:58.713489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:58.780960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:58.792614 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8f43cd00-04cf-4834-9e92-3c6e4da45108 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.210289 Aug 24 17:30:58.793713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 381/689] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:58 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:30:58.909602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:58.919088 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9149c48e-e58a-484c-ab20-4806c446fd4f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1714 microversion: 2.1 time: 0.220872 Aug 24 17:30:58.919685 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 309/690] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:58 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1714 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:30:59.341584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:59.344736 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:59.353785 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:59.354520 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:59.355195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:59.356121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:59.356732 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:59.357358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:59.440122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-32d3c59e-27be-41f0-a047-c51a5504a4e3 req-82ae83ef-4d3d-4c84-8b78-31aa7e7d6026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c94f29-0255-41b2-8d0e-9cb5b207b1c5", "name": "network-vif-plugged", "status": "completed", "tag": "c45cd91b-3f4f-4af5-bc7b-065f2fa372d1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:30:59.458259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-32d3c59e-27be-41f0-a047-c51a5504a4e3 req-82ae83ef-4d3d-4c84-8b78-31aa7e7d6026 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:59.513790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-32d3c59e-27be-41f0-a047-c51a5504a4e3 req-82ae83ef-4d3d-4c84-8b78-31aa7e7d6026 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:59.513790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-32d3c59e-27be-41f0-a047-c51a5504a4e3 req-82ae83ef-4d3d-4c84-8b78-31aa7e7d6026 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:59.513790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-32d3c59e-27be-41f0-a047-c51a5504a4e3 req-82ae83ef-4d3d-4c84-8b78-31aa7e7d6026 service nova] Creating event network-vif-plugged:c45cd91b-3f4f-4af5-bc7b-065f2fa372d1 for instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 on hv-cinder-85164 Aug 24 17:30:59.513790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-32d3c59e-27be-41f0-a047-c51a5504a4e3 req-82ae83ef-4d3d-4c84-8b78-31aa7e7d6026 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049172 Aug 24 17:30:59.513790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 310/691] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:30:59.604705 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:59.615898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:59.618104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:30:59.619402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a5380939-b5a6-4688-9767-4674d751b9a9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.294043 Aug 24 17:30:59.620008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 382/692] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:30:59 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:30:59.817137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:30:59.818203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:30:59.829035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:59.829809 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:59.830505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:30:59.831928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:30:59.832665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:30:59.833356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:00.065348 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:00.074980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec2d4330-4204-479d-afd1-9c99588ea377 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.263867 Aug 24 17:31:00.075627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 311/693] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:30:59 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:31:00.645269 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:00.645885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:00.656005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:00.656816 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:00.657534 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:00.658667 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:00.659424 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:00.660177 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:00.840805 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:00.852408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:00.854293 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:00.855547 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e2e3bac3-dc92-412e-b90d-e5385e76001e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.214794 Aug 24 17:31:00.856153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 383/694] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:00 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:00.951267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:31:00.951884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Wed Aug 24 17:31:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:31:01.101775 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:01.103107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:01.118472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:01.119698 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:01.120668 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:01.121919 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:01.123056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:01.123928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:01.361135 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:01.373921 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cd183173-4529-4926-9539-e5f880efd044 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.279850 Aug 24 17:31:01.374528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 312/695] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:01 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:01.882298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:01.883104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:01.891459 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:01.892102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:01.892692 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:01.893597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:01.894412 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:01.894966 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:02.065607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:02.075074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:02.076588 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:02.077754 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-404a6e36-c602-480d-8f8e-376c489b74f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.199919 Aug 24 17:31:02.078319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 384/696] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:01 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:02.400690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:02.401555 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:02.409805 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:02.410294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:02.410730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:02.411468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:02.411917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:02.412340 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:02.609675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:02.616833 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:02.625453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d249dbda-ca2a-45f3-9fa4-bd45a52edba5 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1358 microversion: 2.1 time: 0.232017 Aug 24 17:31:02.626293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 313/697] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:02 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:03.105312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:03.106426 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:03.125880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:03.126462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:03.126930 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:03.127654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:03.128121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:03.128549 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:03.312902 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:03.328186 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:03.331022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:03.333153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d6d6e9d2-1b4e-4c23-8139-a632f90f07ae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.234933 Aug 24 17:31:03.334152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 385/698] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:03 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:03.650895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:03.651743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:03.660326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:03.660973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:03.661698 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:03.663097 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:03.663776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:03.664224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:03.858738 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:03.872440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-05cc802f-f43f-43e5-a281-2372702e364b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1548 microversion: 2.1 time: 0.227914 Aug 24 17:31:03.874126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 314/699] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:03 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1548 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:31:03.910081 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:03.911341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:03.922569 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:03.923510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:03.924276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:03.925518 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:03.927085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:03.927085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:04.109541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:04.121968 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2354b7a5-d8ef-437b-9a23-fc50324f8faf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1548 microversion: 2.1 time: 0.218561 Aug 24 17:31:04.122577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 386/700] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:03 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1548 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:04.147467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:04.156291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:04.157654 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Searching by: {'deleted': False, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd'} {{(pid=121010) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 17:31:04.168369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:04.168903 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:04.169501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:04.170450 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:04.171163 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:04.171830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:04.315516 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.multi_cell_list [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121010) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 17:31:04.484210 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3225f15d-71b0-41e1-b317-d2fe915d08d3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.344150 Aug 24 17:31:04.485018 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 315/701] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Aug 24 17:31:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:31:04.505228 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:04.506330 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:04.518009 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:04.518872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:04.519960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:04.521234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:04.522078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:04.522868 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:04.751453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:04.766697 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-32d74d38-0f8e-4ee6-8795-f6be9480c46d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1548 microversion: 2.1 time: 0.268672 Aug 24 17:31:04.773119 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 316/702] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:04 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1548 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:31:04.790972 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:04.791950 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:04.800978 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:04.801884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:04.802609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:04.804622 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:04.805183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:04.805757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:05.031322 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:05.047252 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:05.050550 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:05.052912 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cab260f6-c29b-4dff-8c5c-6f21fa236998 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1744 microversion: 2.20 time: 0.690589 Aug 24 17:31:05.054355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 387/703] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:04 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1744 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:06.068688 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b08f3c43-c6df-43a4-8548-25a73b90b4ca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: .version_select at 0x7f3f30161700>, body: {"keypair": {"name": "tempest-keypair-646865061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4bx+dVIFN3C1KzQcampIB9IdefWm4mog71lwkI6U90wzKMch/9H3mRXfe3lmAFmoKu5ATPxEK2egjxOsgABbIK4jOX5a8EEn2BtmtNyDGwk1LEZSEpFLIwvFrB29ewSg=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:06.098357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:06.098357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:06.099374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-b08f3c43-c6df-43a4-8548-25a73b90b4ca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:31:06.102039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:06.103164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:06.104073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:06.105221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:06.105364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-b08f3c43-c6df-43a4-8548-25a73b90b4ca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for user 160ce86c89ea449da346d98d20ce2a9e and project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:31:06.106278 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:06.106761 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:06.293543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b08f3c43-c6df-43a4-8548-25a73b90b4ca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.235200 Aug 24 17:31:06.294963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 317/704] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:31:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:31:06.383376 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:06.409616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:06.409616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:06.409616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9d3a00f4-c67f-44d7-8b26-3cb884344edf tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.319358 Aug 24 17:31:06.410077 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 388/705] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:06 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:07.474031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:07.481094 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:07.509896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:07.524318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:07.524318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:07.524318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:07.524318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:07.524989 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:07.805689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:07.817058 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:07.819762 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:07.821248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-62a72275-5a03-4610-803a-00306070786c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.390946 Aug 24 17:31:07.822156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 318/706] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:07 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:08.418109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8cf7aeb8-6978-4f20-80d2-4c5067798c6f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1055fdc3-f235-4f83-87e9-5144e4afb7f5"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:08.420671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8cf7aeb8-6978-4f20-80d2-4c5067798c6f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:08.428056 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8cf7aeb8-6978-4f20-80d2-4c5067798c6f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:08.428943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8cf7aeb8-6978-4f20-80d2-4c5067798c6f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:08.429358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8cf7aeb8-6978-4f20-80d2-4c5067798c6f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:08.430010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8cf7aeb8-6978-4f20-80d2-4c5067798c6f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:08.430474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8cf7aeb8-6978-4f20-80d2-4c5067798c6f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:08.430948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8cf7aeb8-6978-4f20-80d2-4c5067798c6f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:08.861034 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:08.861872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:08.871050 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:08.871936 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:08.872665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:08.873571 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:08.874213 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:08.874844 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:09.328314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:09.350218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:09.355198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:09.365256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cae8b0d3-265c-4238-bf55-ff5033f2b3fb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.507872 Aug 24 17:31:09.367654 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 319/707] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:08 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:09.646633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8cf7aeb8-6978-4f20-80d2-4c5067798c6f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "POST /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.232103 Aug 24 17:31:09.655730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 389/708] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:31:08 2022] POST /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments => generated 194 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:31:10.406957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:10.406957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:10.408187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:10.408187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:10.409670 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:10.410505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:10.411838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:10.412582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:10.623365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:10.633028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:10.634743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:10.636272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b3ffef4c-7ed5-4cf8-85fa-dbe9c3cbde2d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.240895 Aug 24 17:31:10.636927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 320/709] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:10 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:10.947383 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-109285236", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9785c9b4-9808-422c-887b-d51293243d04"}], "security_groups": [{"name": "tempest-securitygroup--2056643386"}], "key_name": "tempest-keypair-646865061", "user_data": "}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:11.668148 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:11.670372 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:11.686125 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:11.687103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:11.687873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:11.689432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:11.690836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:11.691965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:11.947557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:11.968662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:11.971196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:11.972748 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-477c0990-a961-41de-a634-da039f0c3608 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.313563 Aug 24 17:31:11.974260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 321/710] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:11 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:13.005707 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:13.011120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:13.022608 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:13.023567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:13.024462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:13.025411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:13.026457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:13.027303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:13.348753 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:13.359739 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:13.361555 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:13.362731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b6db986-0817-4bcd-9a24-4ddf879b8a06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.363826 Aug 24 17:31:13.363332 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 322/711] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:12 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:14.398457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:14.400172 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:14.402945 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:14.408645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:14.413724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:14.413724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:14.413724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:14.413724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:14.414115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:14.645136 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:14.662956 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:14.665851 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:14.667216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9e098c46-7956-4358-a2b0-75104087e6db tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.273930 Aug 24 17:31:14.690690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 323/712] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:14 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:15.712148 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:15.713205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:15.720131 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:15.720784 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:15.721407 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:15.722607 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:15.723341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:15.723825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:15.950792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:15.965079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:15.973557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:15.975181 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] validate_networks() for [('9785c9b4-9808-422c-887b-d51293243d04', None, None, None, None, None)] {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:31:15.977342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-817f69bc-1437-4335-a0f9-9479ff359f49 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.268219 Aug 24 17:31:15.977760 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 324/713] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:15 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:16.826863 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:31:16.828235 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:31:16.828945 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:31:16.829640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:31:16.830275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:31:16.844581 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:16.845076 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:16.845517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:16.846463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:16.847271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:16.847658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:16.875060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:31:16.884797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for user 160ce86c89ea449da346d98d20ce2a9e and project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:31:16.908265 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:31:16.913926 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:31:17.012334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:17.014456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:17.020370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:17.031783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:17.033279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:17.034336 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:17.036526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:17.037177 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:17.037548 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:17.103935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-52c4da0c-524f-41c5-9958-b4a04bb046f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.163358 Aug 24 17:31:17.122403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 390/714] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:31:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 6184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:31:17.136843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-53b2879e-2ad2-4c47-a298-b674d6cdcf9a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:17.140053 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-53b2879e-2ad2-4c47-a298-b674d6cdcf9a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:17.243187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-53b2879e-2ad2-4c47-a298-b674d6cdcf9a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:17.268609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-53b2879e-2ad2-4c47-a298-b674d6cdcf9a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1240 microversion: 2.1 time: 0.144183 Aug 24 17:31:17.271020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 391/715] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:17 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1240 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:17.436268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:17.454375 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:17.461664 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:17.465075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-970e082e-399f-4921-9442-a7fb9fdea018 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.461776 Aug 24 17:31:17.484076 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 325/716] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:17 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:18.305485 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a974e9de-a3ae-4a72-86e5-6d9f4d2e7b5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:18.307567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a974e9de-a3ae-4a72-86e5-6d9f4d2e7b5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:18.402321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a974e9de-a3ae-4a72-86e5-6d9f4d2e7b5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:18.414410 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a974e9de-a3ae-4a72-86e5-6d9f4d2e7b5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1240 microversion: 2.1 time: 0.115875 Aug 24 17:31:18.415681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 392/717] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:18 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:18.518199 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:18.519429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:18.532103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:18.533584 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:18.534502 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:18.535991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:18.536752 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:18.537686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:18.847251 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:18.857407 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:18.858973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:18.860226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d0b70b12-b72d-42b7-ae77-6da34c82e5eb tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.347813 Aug 24 17:31:18.860810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 326/718] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:18 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:19.459208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:19.460146 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:19.482029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:19.482940 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:19.484193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:19.485921 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:19.487176 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:19.488307 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:19.597107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:19.608366 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-18522dcc-e977-448c-90cc-e3e79edb9aca tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1244 microversion: 2.1 time: 0.160304 Aug 24 17:31:19.609141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 393/719] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:19 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1244 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:19.896559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:19.897486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:19.899686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:19.905096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:19.905615 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:19.906069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:19.906796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:19.907302 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:19.907728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:20.090847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:20.104309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:20.107926 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:20.123807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ca52e5a-f8c1-4b88-9195-bc4f44eec796 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.222223 Aug 24 17:31:20.123807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 327/720] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:19 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:20.124187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:20.124187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:20.130465 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:20.131149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:20.131879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:20.132859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:20.133525 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:20.134194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:20.326068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:20.339707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-907fe2a3-1725-4d6c-91af-229b0c198799 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1594 microversion: 2.1 time: 0.222053 Aug 24 17:31:20.340680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 394/721] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:20 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1594 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:31:20.635737 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:20.637471 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:20.648674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:20.649735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:20.650372 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:20.651497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:20.652283 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:20.653040 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:20.778492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:20.797217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9c2321cf-0e9e-4057-ae8c-5b87ff1763d3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1292 microversion: 2.1 time: 0.167978 Aug 24 17:31:20.812298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 328/722] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:20 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1292 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:21.164479 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:21.171084 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:21.217210 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:21.223212 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:21.224532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:21.226205 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:21.227443 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:21.228581 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:21.520065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:21.532948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:21.534768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:21.536138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8835998e-c2d4-4046-89d6-cb71a2389e2a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.380123 Aug 24 17:31:21.536786 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 395/723] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:21 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:21.838758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:21.839743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:21.848421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:21.849318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:21.849978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:21.851019 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:21.851745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:21.852363 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:22.230003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:22.238133 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-db81ae69-ef7e-4ff1-9d3d-96c940eb82f6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1300 microversion: 2.1 time: 0.407638 Aug 24 17:31:22.238835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 329/724] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:21 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1300 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:22.564327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:22.565454 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:22.577755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:22.578615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:22.579445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:22.580701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:22.581511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:22.582233 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:22.875301 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:22.885707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:22.887233 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:22.888452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d3e7769e-4428-4af4-b594-bac61eff7214 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.331450 Aug 24 17:31:22.889341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 396/725] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:22 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:23.273694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:23.274472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:23.284023 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:23.284884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:23.285653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:23.286863 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:23.287715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:23.289006 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:23.373392 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:23.389113 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e3ceae14-df13-41cf-bb50-a141e3443ae1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1298 microversion: 2.1 time: 0.119744 Aug 24 17:31:23.390350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 330/726] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:23 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:31:23.916179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:23.917175 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:23.925010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:23.925492 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:23.925925 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:23.926764 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:23.927338 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:23.927858 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:24.226789 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:24.238885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:24.242023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:24.244201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-68047664-2bf8-424b-afff-f82ec49983f2 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1739 microversion: 2.20 time: 0.333960 Aug 24 17:31:24.245555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 397/727] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:23 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1739 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:24.415569 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:24.416289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:24.428280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:24.428809 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:24.429249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:24.430266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:24.430727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:24.431392 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:24.438245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:24.521078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:24.543812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-087a3650-bfc8-4862-8866-3d839cd2d188 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1298 microversion: 2.1 time: 0.123027 Aug 24 17:31:24.543812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 331/728] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:24 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:24.897089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-bc6fa228-45f7-45e2-a886-9ef6f5d854fd req-ee9fb9b2-c71c-4cd9-abef-cf84a4f54b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c94f29-0255-41b2-8d0e-9cb5b207b1c5", "tag": "c45cd91b-3f4f-4af5-bc7b-065f2fa372d1"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:24.908471 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-bc6fa228-45f7-45e2-a886-9ef6f5d854fd req-ee9fb9b2-c71c-4cd9-abef-cf84a4f54b4a service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:24.908964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-bc6fa228-45f7-45e2-a886-9ef6f5d854fd req-ee9fb9b2-c71c-4cd9-abef-cf84a4f54b4a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:24.909403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-bc6fa228-45f7-45e2-a886-9ef6f5d854fd req-ee9fb9b2-c71c-4cd9-abef-cf84a4f54b4a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:24.922948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-bc6fa228-45f7-45e2-a886-9ef6f5d854fd req-ee9fb9b2-c71c-4cd9-abef-cf84a4f54b4a service nova] Creating event network-changed:c45cd91b-3f4f-4af5-bc7b-065f2fa372d1 for instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 on hv-cinder-85164 Aug 24 17:31:24.929016 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-bc6fa228-45f7-45e2-a886-9ef6f5d854fd req-ee9fb9b2-c71c-4cd9-abef-cf84a4f54b4a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127793 Aug 24 17:31:24.929637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 398/729] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:31:25.268814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:25.269424 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:25.277194 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:25.278025 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:25.278660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:25.280054 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:25.280984 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:25.281575 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:25.556616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:25.557709 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:25.569051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:25.571109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:25.574748 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:25.581664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:25.583026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:25.588949 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:25.590097 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:25.601255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:25.603838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:25.605415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-30ea6a6f-a448-4eb1-9113-5d45dd311e0d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1721 microversion: 2.20 time: 0.340914 Aug 24 17:31:25.606303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 332/730] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:25 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:25.646426 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:25.843642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:25.859989 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-258f6add-ee22-4d28-a798-30f3ddab54b7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.303994 Aug 24 17:31:25.862614 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 399/731] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:25 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:26.632625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:26.638587 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:26.646107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:26.646690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:26.647258 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:26.647903 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:26.648586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:26.649197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:26.838888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:26.847777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:26.849269 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:26.850948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb734f3a-9d84-45ea-992c-02be838a3abd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1721 microversion: 2.20 time: 0.222194 Aug 24 17:31:26.851519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 333/732] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:26 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:26.900924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:26.901940 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:26.906224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:26.913741 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:26.914541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:26.915138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:26.916126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:26.916774 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:26.917331 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:27.219840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:27.233377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-82af63f0-6e88-489a-9721-c06cdebea563 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.339185 Aug 24 17:31:27.235755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 400/733] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:26 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:27.362689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-785b6a08-79d7-4f0c-bd78-6f05daafebca req-9f281f17-3e6b-4f59-925c-b25e8cf90436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5542f65d-3efd-4dc6-9c28-ea9d8ac19317", "name": "network-vif-unplugged", "status": "completed", "tag": "afddf061-f22c-4311-aa82-82860263ce79"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:27.375842 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-785b6a08-79d7-4f0c-bd78-6f05daafebca req-9f281f17-3e6b-4f59-925c-b25e8cf90436 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:27.376567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-785b6a08-79d7-4f0c-bd78-6f05daafebca req-9f281f17-3e6b-4f59-925c-b25e8cf90436 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:27.377142 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-785b6a08-79d7-4f0c-bd78-6f05daafebca req-9f281f17-3e6b-4f59-925c-b25e8cf90436 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:27.389660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-785b6a08-79d7-4f0c-bd78-6f05daafebca req-9f281f17-3e6b-4f59-925c-b25e8cf90436 service nova] Creating event network-vif-unplugged:afddf061-f22c-4311-aa82-82860263ce79 for instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 on hv-cinder-85164 Aug 24 17:31:27.396925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-785b6a08-79d7-4f0c-bd78-6f05daafebca req-9f281f17-3e6b-4f59-925c-b25e8cf90436 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038621 Aug 24 17:31:27.396925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 334/734] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:31:27.496070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-23068e55-ee97-4460-b1dc-abeffc5e14e4 req-b24274fc-bc50-4a2c-99a7-479a6de0a6cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86633f37-ebff-41dd-b6e6-2ece18437ab1", "tag": "994fe834-85b7-4f02-9b3f-7a5091c552f2"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:27.503124 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:27.513297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-23068e55-ee97-4460-b1dc-abeffc5e14e4 req-b24274fc-bc50-4a2c-99a7-479a6de0a6cf service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:27.514612 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-23068e55-ee97-4460-b1dc-abeffc5e14e4 req-b24274fc-bc50-4a2c-99a7-479a6de0a6cf service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:27.515364 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-23068e55-ee97-4460-b1dc-abeffc5e14e4 req-b24274fc-bc50-4a2c-99a7-479a6de0a6cf service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:27.531425 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-23068e55-ee97-4460-b1dc-abeffc5e14e4 req-b24274fc-bc50-4a2c-99a7-479a6de0a6cf service nova] Creating event network-changed:994fe834-85b7-4f02-9b3f-7a5091c552f2 for instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 on hv-cinder-85164 Aug 24 17:31:27.537346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-23068e55-ee97-4460-b1dc-abeffc5e14e4 req-b24274fc-bc50-4a2c-99a7-479a6de0a6cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049000 Aug 24 17:31:27.539101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 401/735] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:31:27.880710 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:27.881415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:27.888229 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:27.888770 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:27.889408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:27.890537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:27.892997 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:27.893660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:28.061852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:28.074631 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:28.076665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:28.078270 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e5a325e-7f0b-41bd-9970-c4c5cd5c2d93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1721 microversion: 2.20 time: 0.203103 Aug 24 17:31:28.079040 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 335/736] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:27 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:28.266859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:28.267977 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:28.281798 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:28.282556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:28.283327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:28.284554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:28.285299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:28.285960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:28.407742 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=10 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:28.481307 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:28.495636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a7560640-4a44-4bd7-aa6f-279122dd8bf6 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.237621 Aug 24 17:31:28.509472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 402/737] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:28 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:29.105308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:29.105923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:29.112822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:29.113307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:29.113744 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:29.115346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:29.115346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:29.115638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:29.295712 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:29.305115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:29.306672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:29.307969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3a5c914b-1c1c-4e09-826a-b604083856df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1721 microversion: 2.20 time: 0.207948 Aug 24 17:31:29.308530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 336/738] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:29 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:29.528873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:29.530350 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:29.535285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1616692482"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:29.536190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:29.540343 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:29.540959 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:29.541397 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:29.542104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:29.542958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:29.543478 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:29.549701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:29.550605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:29.551686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:29.553116 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:29.553725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:29.554402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:29.752459 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:29.762765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-77cc7414-1073-4c52-9c52-fda8d44cfe4b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.237712 Aug 24 17:31:29.763674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 403/739] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:29 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:29.815038 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.network.security_group_api [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Adding security group 4a37194b-b203-4fa4-8143-5105b9a0ccd3 to port c45cd91b-3f4f-4af5-bc7b-065f2fa372d1 Aug 24 17:31:30.333730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:30.334516 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:30.343575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:30.344300 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:30.346022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:30.346928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:30.347930 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:30.348483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:30.455624 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cde6e1ba-13d3-4727-8e4a-8700eee014c4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "POST /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/action" status: 202 len: 0 microversion: 2.1 time: 0.926537 Aug 24 17:31:30.455624 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 337/740] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:31:29 2022] POST /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/action => generated 0 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:31:30.469777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:30.470722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:30.482263 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:30.483605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:30.486933 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:30.488724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:30.489787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:30.490727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:31.083647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:31.093813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:31.095599 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:31.100504 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-49f0a57e-3956-47c9-9197-d0c47e868d4b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1724 microversion: 2.20 time: 0.767668 Aug 24 17:31:31.100504 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 404/741] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:30 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1724 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:31.103419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-93fd5703-6d05-44bc-a58f-f02ec50da0ef req-98560fb5-838b-42a7-a97b-b2a5de30b095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c94f29-0255-41b2-8d0e-9cb5b207b1c5", "tag": "c45cd91b-3f4f-4af5-bc7b-065f2fa372d1"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:31.119065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-93fd5703-6d05-44bc-a58f-f02ec50da0ef req-98560fb5-838b-42a7-a97b-b2a5de30b095 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:31.119933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-93fd5703-6d05-44bc-a58f-f02ec50da0ef req-98560fb5-838b-42a7-a97b-b2a5de30b095 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:31.120452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-93fd5703-6d05-44bc-a58f-f02ec50da0ef req-98560fb5-838b-42a7-a97b-b2a5de30b095 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:31.122467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:31.136797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-93fd5703-6d05-44bc-a58f-f02ec50da0ef req-98560fb5-838b-42a7-a97b-b2a5de30b095 service nova] Creating event network-changed:c45cd91b-3f4f-4af5-bc7b-065f2fa372d1 for instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 on hv-cinder-85164 Aug 24 17:31:31.141163 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6ce46d2-9fdd-4bb3-9850-1b5bcff98f30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1760 microversion: 2.1 time: 0.677348 Aug 24 17:31:31.142854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 338/742] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:30 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1760 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:31.146340 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-93fd5703-6d05-44bc-a58f-f02ec50da0ef req-98560fb5-838b-42a7-a97b-b2a5de30b095 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046907 Aug 24 17:31:31.152191 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:31.152611 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 405/743] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:31:31.153580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:31.160361 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d4411304-3443-4169-9cc2-98d3cf7d224c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37076c1c-33ad-4ecb-9891-79fdbbca2cb3"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:31.162299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:31.162847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:31.163483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:31.164222 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d4411304-3443-4169-9cc2-98d3cf7d224c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:31.164603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:31.165079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:31.165504 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:31.171260 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d4411304-3443-4169-9cc2-98d3cf7d224c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:31.171831 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d4411304-3443-4169-9cc2-98d3cf7d224c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:31.172340 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d4411304-3443-4169-9cc2-98d3cf7d224c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:31.173166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d4411304-3443-4169-9cc2-98d3cf7d224c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:31.173653 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d4411304-3443-4169-9cc2-98d3cf7d224c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:31.174791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d4411304-3443-4169-9cc2-98d3cf7d224c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:31.332309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:31.344240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-807cca91-f02d-471c-8e9e-5f319b721400 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.198821 Aug 24 17:31:31.344940 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 339/744] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:31 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:32.370163 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:32.370843 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:32.377390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:32.377882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:32.378349 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:32.379090 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:32.379557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:32.379989 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:32.536749 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:32.545653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b82b41a4-01a8-4842-9416-988fad24a848 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.179276 Aug 24 17:31:32.546382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 340/745] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:32 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:31:32.606047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d4411304-3443-4169-9cc2-98d3cf7d224c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.451429 Aug 24 17:31:32.607117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 406/746] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Aug 24 17:31:31 2022] POST /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments => generated 188 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:31:32.765452 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:32.766110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:32.773335 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:32.773825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:32.774261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:32.774983 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:32.775481 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:32.775873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:32.879645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121010) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:31:33.221917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b864386b-9903-4d1e-adf2-1863dbf26dae tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/action" status: 202 len: 0 microversion: 2.20 time: 0.460438 Aug 24 17:31:33.222542 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 341/747] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 24 17:31:32 2022] POST /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:31:33.231163 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:33.231719 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:33.238603 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:33.239127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:33.239890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:33.242014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:33.242473 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:33.242827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:33.432758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:33.442491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:33.444178 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:33.445406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a56983fe-670e-41d1-aa7a-7b03bfaf2792 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1810 microversion: 2.20 time: 0.218330 Aug 24 17:31:33.445969 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 407/748] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:33 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:33.569283 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:33.570081 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:33.577064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:33.577661 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:33.578159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:33.578977 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:33.579465 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:33.580072 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:33.765783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:33.775273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cccf29b7-2417-4817-a753-459042073262 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.210309 Aug 24 17:31:33.775955 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 342/749] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:33 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:31:34.475808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:34.476552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:34.486891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:34.487732 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:34.487732 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:34.489058 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:34.489894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:34.490493 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:34.665885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:34.679599 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:34.682222 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:34.683961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e4a32ac6-28e1-447c-a55e-809b5edae002 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1750 microversion: 2.20 time: 0.214687 Aug 24 17:31:34.685309 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 408/750] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:34 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1750 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:34.800273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:34.801149 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:34.812670 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:34.814632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:34.815454 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:34.817935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:34.818694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:34.827628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:34.986774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:34.995831 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-03c92ea2-4b5b-4544-aad4-b9cfd854425f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.202638 Aug 24 17:31:34.996480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 343/751] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:34 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:35.712402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:35.713390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:35.720658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:35.721191 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:35.721850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:35.722568 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:35.723078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:35.723513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:35.906722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:35.916238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:35.918115 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:35.919350 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8ba2d0ca-d089-4af1-9e7d-216db8b9c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1752 microversion: 2.20 time: 0.211749 Aug 24 17:31:35.919924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 409/752] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:35 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1752 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:36.020044 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:36.021119 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:36.039165 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:36.039472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:36.040117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:36.040626 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:36.041109 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:36.041511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:36.212513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:36.221882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ed5d5481-714c-431e-9058-a70b8fede39e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.207706 Aug 24 17:31:36.222472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 344/753] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:36 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:36.950484 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:36.951708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:36.959377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:36.960238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:36.960621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:36.961315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:36.961603 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:36.962033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:37.134603 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:37.145523 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:37.147193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:37.148415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-01270e1a-a8d0-4b82-b288-daa0f54713d4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1752 microversion: 2.20 time: 0.202640 Aug 24 17:31:37.148988 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 410/754] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:36 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:37.256909 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:37.258194 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:37.270694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:37.277623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:37.277623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:37.277623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:37.277623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:37.278060 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:37.456562 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:37.465434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e9d03b29-7a12-4490-a116-3af454b1e528 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.216619 Aug 24 17:31:37.466023 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 345/755] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:37 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:38.173787 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:38.174734 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:38.186016 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:38.190859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:38.190859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:38.190859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:38.190859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:38.191541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:38.385308 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:38.397997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:38.399575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:38.401060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-41a0ac74-0042-4380-badc-f324112ed479 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.232075 Aug 24 17:31:38.401649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 411/756] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:38 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:38.491529 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:38.493216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:38.500324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:38.500817 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:38.501259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:38.501967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:38.502425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:38.502853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:38.703074 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:38.711072 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2df5660c-fbc1-4f1b-b374-6fdf2ea8a4f5 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.224637 Aug 24 17:31:38.711678 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 346/757] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:38 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:38.773748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-8bf04a4d-022a-485e-bfc0-041cb09e4c3a req-033ed58a-54ba-4f35-8c84-a2f9e39e7216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86633f37-ebff-41dd-b6e6-2ece18437ab1", "name": "network-vif-plugged", "status": "completed", "tag": "994fe834-85b7-4f02-9b3f-7a5091c552f2"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:38.790850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-8bf04a4d-022a-485e-bfc0-041cb09e4c3a req-033ed58a-54ba-4f35-8c84-a2f9e39e7216 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:38.791372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-8bf04a4d-022a-485e-bfc0-041cb09e4c3a req-033ed58a-54ba-4f35-8c84-a2f9e39e7216 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:38.791807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-8bf04a4d-022a-485e-bfc0-041cb09e4c3a req-033ed58a-54ba-4f35-8c84-a2f9e39e7216 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:38.805013 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-8bf04a4d-022a-485e-bfc0-041cb09e4c3a req-033ed58a-54ba-4f35-8c84-a2f9e39e7216 service nova] Creating event network-vif-plugged:994fe834-85b7-4f02-9b3f-7a5091c552f2 for instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 on hv-cinder-85164 Aug 24 17:31:38.811926 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-8bf04a4d-022a-485e-bfc0-041cb09e4c3a req-033ed58a-54ba-4f35-8c84-a2f9e39e7216 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127619 Aug 24 17:31:38.812814 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 412/758] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:31:39.425672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:39.426386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:39.434142 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:39.435033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:39.435708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:39.436866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:39.437419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:39.437942 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:39.602303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:39.608595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:39.614835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:39.617110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:39.618347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c43562a2-65ff-42b6-9544-4dc1ec6e938f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.198070 Aug 24 17:31:39.618931 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 347/759] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:39 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:39.744955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:39.745644 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:39.752804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:39.753379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:39.753859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:39.754657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:39.755227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:39.755696 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:39.900185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:39.908507 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fd1d748e-db12-4ef6-a8f5-8dbfb75df61a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.168187 Aug 24 17:31:39.910176 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 413/760] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:39 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:40.641969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:40.642553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:40.650324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:40.650725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:40.651180 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:40.651872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:40.652315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:40.652741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:40.801783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:40.814111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:40.816358 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:40.817563 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1aad1f98-187f-4979-9eca-be2616f73cd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.179471 Aug 24 17:31:40.818130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 348/761] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:40 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:40.930847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:40.931439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:40.938325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:40.938822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:40.939285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:40.939975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:40.940420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:40.940864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:41.120803 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:41.129239 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6a458b7d-2f11-4d7f-a115-99708745e0ce tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1366 microversion: 2.1 time: 0.202955 Aug 24 17:31:41.143013 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 414/762] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:40 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:41.843178 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:41.846665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:41.853491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:41.853491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:41.853491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:41.853491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:41.854108 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:41.854108 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:42.018947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:42.028868 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:42.030439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:42.031747 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c834b409-288f-4398-9056-29cedafa560a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.193363 Aug 24 17:31:42.032318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 349/763] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:41 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:42.153151 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:42.153618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:42.161423 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:42.162452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:42.164021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:42.165066 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:42.165710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:42.166182 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:42.190521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:42.348255 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:42.365615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b02f826b-1983-4006-994c-0c1f3740204c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1555 microversion: 2.1 time: 0.216081 Aug 24 17:31:42.367987 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 415/764] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:31:42 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:31:42.410839 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b4fd539-18ab-4a5b-b567-b8f5cd8987f3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:42.410839 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b4fd539-18ab-4a5b-b567-b8f5cd8987f3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:42.413534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b4fd539-18ab-4a5b-b567-b8f5cd8987f3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:42.414214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b4fd539-18ab-4a5b-b567-b8f5cd8987f3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:42.414870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b4fd539-18ab-4a5b-b567-b8f5cd8987f3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:42.419975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b4fd539-18ab-4a5b-b567-b8f5cd8987f3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:42.420789 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b4fd539-18ab-4a5b-b567-b8f5cd8987f3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:42.421437 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b4fd539-18ab-4a5b-b567-b8f5cd8987f3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:42.583493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b4fd539-18ab-4a5b-b567-b8f5cd8987f3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189840 Aug 24 17:31:42.584875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 350/765] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 24 17:31:42 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:31:43.061613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:43.063174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:43.076590 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:43.080631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:43.080631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:43.080631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:43.080631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:43.082183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:43.311625 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:43.322010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:43.324242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:43.329737 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c17c8487-3300-486e-9301-96600c70498c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.270423 Aug 24 17:31:43.329737 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 416/766] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:43 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:44.085293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-4b141c0b-6647-4ae4-bb2a-bc952c5e9efb req-28964e27-2778-401c-ade4-83fd895539e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86633f37-ebff-41dd-b6e6-2ece18437ab1", "tag": "994fe834-85b7-4f02-9b3f-7a5091c552f2"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:31:44.098494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4b141c0b-6647-4ae4-bb2a-bc952c5e9efb req-28964e27-2778-401c-ade4-83fd895539e0 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:44.099087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4b141c0b-6647-4ae4-bb2a-bc952c5e9efb req-28964e27-2778-401c-ade4-83fd895539e0 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:44.099623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-4b141c0b-6647-4ae4-bb2a-bc952c5e9efb req-28964e27-2778-401c-ade4-83fd895539e0 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:44.115447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-4b141c0b-6647-4ae4-bb2a-bc952c5e9efb req-28964e27-2778-401c-ade4-83fd895539e0 service nova] Creating event network-changed:994fe834-85b7-4f02-9b3f-7a5091c552f2 for instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 on hv-cinder-85164 Aug 24 17:31:44.122107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-4b141c0b-6647-4ae4-bb2a-bc952c5e9efb req-28964e27-2778-401c-ade4-83fd895539e0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043316 Aug 24 17:31:44.122868 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 351/767] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:31:44.353854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:44.355099 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:44.363158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:44.363739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:44.364241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:44.365036 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:44.366276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:44.366834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:44.558509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:44.568788 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:44.570885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:44.572360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5a1caa0a-6ab8-4320-a926-9748553e6382 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.222949 Aug 24 17:31:44.578992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 417/768] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:44 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:45.597375 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:45.601341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:45.611082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:45.611752 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:45.612308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:45.613899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:45.614502 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:45.614992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:45.826505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:45.838021 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:45.842571 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:45.842571 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8231d947-2371-4cae-8562-5203a3b442b0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.250220 Aug 24 17:31:45.842571 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 352/769] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:45 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:46.879847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:46.880499 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:46.888240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:46.891819 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:46.891819 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:46.891819 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:46.891819 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:46.892202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:47.071110 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:47.081477 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:47.083135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:47.084297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ed41c243-ea69-4836-880d-a92295005c1f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.208665 Aug 24 17:31:47.085446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 418/770] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:46 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:31:48.108632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:48.110121 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:48.117855 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:48.118928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:48.119970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:48.121143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:48.121972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:48.122724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:48.311169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:48.321655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:48.323219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:48.324700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6c890592-26ee-45ca-9f14-f8a7f0d56827 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.220127 Aug 24 17:31:48.325610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 353/771] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:48 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:49.349656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:49.350777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:49.357374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:49.357865 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:49.358299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:49.359017 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:49.359473 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:49.359896 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:49.508682 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:49.517370 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:49.518873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:49.520043 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e6a7d7a8-4893-4933-a633-e33551843c18 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.174305 Aug 24 17:31:49.520868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 419/772] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:49 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:50.542836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:50.543539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:50.550410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:50.550925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:50.551381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:50.552081 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:50.552533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:50.552963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:50.700436 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:50.712646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:50.714168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:50.715426 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dfd77f42-e830-49b7-ac09-9b3c0e82457f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.176556 Aug 24 17:31:50.716181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 354/773] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:50 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:51.746806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:51.747757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:51.753679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:51.754159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:51.754590 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:51.755315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:51.755841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:51.761189 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:51.889276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:51.898105 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:51.899636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:51.900781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1d106538-1fa9-4830-a6d2-9fe188b34213 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.158102 Aug 24 17:31:51.901345 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 420/774] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:51 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:52.923927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:52.924561 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:52.927274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:31:52.933611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:52.934483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:52.935879 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:52.935879 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:52.942270 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:52.942270 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:53.111780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:53.131839 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:53.134531 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:53.136546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7506f3d7-7619-4454-88c8-1ba118dac4c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.216668 Aug 24 17:31:53.137478 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 355/775] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:52 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:54.163922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:54.163922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:54.170850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:54.171372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:54.171805 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:54.172500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:54.172952 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:54.173493 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:54.323652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:54.333398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:54.335626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:54.337092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5a53bee1-09d3-4b09-aff4-3b692f5ea9f8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.178817 Aug 24 17:31:54.337716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 421/776] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:54 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:55.367953 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:55.368666 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:55.375649 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:55.376135 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:55.376568 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:55.377277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:55.377725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:55.378146 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:55.542832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:55.554308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:55.556207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:55.557477 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5006783-3cdf-43fc-8e39-7174444a14c8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.195427 Aug 24 17:31:55.579524 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 356/777] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:55 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:56.580339 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:56.581380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:56.589096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:56.589618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:56.590035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:56.590776 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:56.591593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:56.594979 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:56.767144 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:56.777442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:56.779020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:56.780183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-75a1c4de-1314-402f-ba0c-93290a268983 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.204149 Aug 24 17:31:56.780747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 422/778] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:56 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:57.805225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:57.805933 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:57.813990 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:57.814774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:57.815258 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:57.816137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:57.816601 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:57.817025 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:57.978247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:57.987425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:57.988942 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:57.990281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-637f5961-5724-4946-8d51-cf9650ca04fe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.189764 Aug 24 17:31:57.990281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 357/779] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:57 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:31:59.014139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:31:59.023372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:31:59.023372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:59.023372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:59.023372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:59.024070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:31:59.024538 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:31:59.024968 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:31:59.243587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:59.256082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:59.257532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:31:59.258739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-faf5d587-7eaa-4cba-85d1-2a35d7ea3ac9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.249592 Aug 24 17:31:59.259506 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 423/780] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:31:59 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:00.282085 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:00.282644 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:00.289666 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:00.290385 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:00.292752 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:00.292752 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:00.293056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:00.293730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:00.433134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:00.441773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:00.443313 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:00.445021 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ce45dcc-fecc-4e7e-847c-48f10eef3802 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.166922 Aug 24 17:32:00.445600 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 358/781] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:00 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:01.468596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:01.469451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:01.475685 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=46 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:32:01.483526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:01.484365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:01.485403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:01.486176 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:01.486801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:01.487267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:01.738862 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:01.757076 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:01.758845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:01.765934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-12974db5-4066-4144-a750-4ebf7777d439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.296234 Aug 24 17:32:01.765934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 424/782] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:01 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:02.788865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:02.789394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:02.796526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:02.797029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:02.797466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:02.798179 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:02.798660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:02.799137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:02.945402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:02.956019 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:02.957589 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:02.959021 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-565c1c67-02d3-4123-ac0b-e2bed2a181e6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.174073 Aug 24 17:32:02.959683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 359/783] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:02 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:03.984414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:03.985070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:03.995289 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:03.995797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:03.996238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:03.996958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:03.997439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:03.997877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:04.156039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:04.166057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:04.167472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:04.168695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-67af9ba2-399c-4a54-8bc6-65d4d629c37d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.188339 Aug 24 17:32:04.169287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 425/784] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:03 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:05.193456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:05.194641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:05.201727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:05.202221 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:05.202660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:05.203387 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:05.203841 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:05.204267 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:05.626344 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:05.636231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:05.637832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:05.639122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3802b16a-3234-46c7-abcd-4df84eefadd7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.449497 Aug 24 17:32:05.645268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 360/785] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:05 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:06.663545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:06.664191 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:06.671888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:06.672385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:06.672884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:06.673606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:06.674064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:06.674534 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:06.827296 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:06.836636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:06.838199 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:06.839455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f9f275c3-b381-40f4-b1bf-4937c5611f19 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.179986 Aug 24 17:32:06.840039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 426/786] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:06 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:07.880331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:07.881417 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:07.892786 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:07.893536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:07.894259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:07.895475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:07.896508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:07.897934 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:08.058233 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:08.073640 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:08.075201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:08.076414 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bcae9db6-59cf-4568-b659-5672a2bfb7c3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.202472 Aug 24 17:32:08.076983 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 361/787] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:07 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:09.100355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:09.101113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:09.108191 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:09.108726 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:09.109175 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:09.109891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:09.110356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:09.110786 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:09.250716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:09.262686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:09.264230 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:09.265389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-79d09389-8f06-416a-bd0f-3a2d6ddae7ad tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.169378 Aug 24 17:32:09.265957 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 427/788] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:09 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:10.288633 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:10.289271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:10.296143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:10.296637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:10.297082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:10.297787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:10.298244 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:10.298670 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:10.435182 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:10.445152 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:10.446649 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:10.447842 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f5940c7c-c10b-42dd-8def-6a1674724999 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.163147 Aug 24 17:32:10.448416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 362/789] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:10 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:11.471628 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:11.472261 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:11.479367 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:11.479862 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:11.480641 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:11.480975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:11.481449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:11.481865 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:11.645782 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:11.660821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:11.663310 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:11.665275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-69ce0ed0-46fe-4a88-a4ce-e75afa74dbfd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.197559 Aug 24 17:32:11.666195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 428/790] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:11 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:12.700547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:12.701818 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:12.708996 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:12.709484 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:12.709921 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:12.710619 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:12.711110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:12.711549 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:12.715903 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=85 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:32:12.803728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-b72a717c-1ff1-4ef7-9403-8679447233e0 req-66319850-9943-4870-9830-3fff41c8e7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5542f65d-3efd-4dc6-9c28-ea9d8ac19317", "name": "network-vif-plugged", "status": "completed", "tag": "afddf061-f22c-4311-aa82-82860263ce79"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:32:12.815300 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-b72a717c-1ff1-4ef7-9403-8679447233e0 req-66319850-9943-4870-9830-3fff41c8e7f7 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:12.815858 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-b72a717c-1ff1-4ef7-9403-8679447233e0 req-66319850-9943-4870-9830-3fff41c8e7f7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:12.817992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-b72a717c-1ff1-4ef7-9403-8679447233e0 req-66319850-9943-4870-9830-3fff41c8e7f7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:12.828771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-b72a717c-1ff1-4ef7-9403-8679447233e0 req-66319850-9943-4870-9830-3fff41c8e7f7 service nova] Creating event network-vif-plugged:afddf061-f22c-4311-aa82-82860263ce79 for instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 on hv-cinder-85164 Aug 24 17:32:12.834012 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-b72a717c-1ff1-4ef7-9403-8679447233e0 req-66319850-9943-4870-9830-3fff41c8e7f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Aug 24 17:32:12.834616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 429/791] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:32:12.851574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:12.860737 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:12.862226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:12.863524 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-698c6d42-7095-4c75-b379-44dcd97d463d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.167433 Aug 24 17:32:12.865003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 363/792] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:12 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:13.893559 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:13.894287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:13.901585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:13.902079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:13.902521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:13.903257 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:13.903713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:13.904143 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:13.907195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=83 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:32:14.048750 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:14.058665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:14.060222 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:14.061434 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-53f407a2-02c1-4744-84ad-718ced3b5066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.172786 Aug 24 17:32:14.062006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 430/793] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:13 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:32:15.087729 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:15.088503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:15.095587 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:15.096079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:15.096514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:15.097216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:15.097671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:15.098096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:15.257774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:15.267582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:15.273851 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:15.273851 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4489d5de-732a-472a-b744-0cd5c0a3424a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.186083 Aug 24 17:32:15.273851 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 364/794] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:15 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:16.295498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:16.296389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:16.302781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:16.303313 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:16.303749 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:16.304444 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:16.304899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:16.305325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:16.498425 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:16.508225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:16.509811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:16.510940 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e4d50b67-a7bb-44ef-bbd5-f46d2e518397 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.219380 Aug 24 17:32:16.511501 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 431/795] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:16 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:32:17.535428 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:17.536214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:17.542534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:17.543058 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:17.543510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:17.544236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:17.544694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:17.545115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:17.694391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:17.703783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:17.705305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:17.706480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-13f41f61-a455-4e19-b978-17888d630b3d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.175459 Aug 24 17:32:17.707081 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 365/796] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:17 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:18.731977 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:18.732708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:18.740311 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:18.740728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:18.741223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:18.741941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:18.742389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:18.742820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:18.879134 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:18.888104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:18.889617 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:18.890799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3f0614e2-3da7-4ecb-9bbb-4fd4a052f4aa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1808 microversion: 2.20 time: 0.164250 Aug 24 17:32:18.891397 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 432/797] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:18 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:32:19.915525 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:19.916154 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:19.922704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:19.924493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:19.924493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:19.924493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:19.924796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:19.925218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:20.074151 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:20.084005 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:20.086181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:20.087489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3125a1b8-9c13-4a9d-ad32-e344d79b7242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1795 microversion: 2.20 time: 0.176598 Aug 24 17:32:20.088059 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 366/798] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:32:19 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1795 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:32:27.146649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-73c637a1-49bc-4979-8224-610e1abd26af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fe611b6-cb8b-441a-a2ef-22911e0a991a"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:32:27.151155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-73c637a1-49bc-4979-8224-610e1abd26af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:27.161084 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73c637a1-49bc-4979-8224-610e1abd26af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:27.161906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73c637a1-49bc-4979-8224-610e1abd26af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:27.162665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73c637a1-49bc-4979-8224-610e1abd26af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:27.163868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73c637a1-49bc-4979-8224-610e1abd26af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:27.165289 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73c637a1-49bc-4979-8224-610e1abd26af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:27.166060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-73c637a1-49bc-4979-8224-610e1abd26af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:28.434222 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-73c637a1-49bc-4979-8224-610e1abd26af tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.474007 Aug 24 17:32:28.434995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 433/799] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:32:26 2022] POST /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments => generated 194 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:32:37.114778 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:32:37.117231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:37.120603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=23 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:32:37.121297 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=23 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:32:37.126730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:37.127337 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:37.127781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:37.128559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:37.129031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:37.134277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:37.160774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lazy-loading 'flavor' on Instance uuid d7feb685-67d6-4b7e-be2b-3e07e65391fb {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:32:37.557512 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bb18cba5-5567-438b-9629-d631006b3138 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/action" status: 200 len: 32 microversion: 2.1 time: 0.445843 Aug 24 17:32:37.560069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 367/800] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:32:37 2022] POST /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/action => generated 32 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:32:37.569364 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=19 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:32:37.577267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:37.583026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:37.586712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:37.589329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:37.589329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:37.589329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:37.589694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:37.590117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:37.742002 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:37.755194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-741ab5ba-8cdb-4f9a-912f-14d9f66c96df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.188003 Aug 24 17:32:37.755861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 434/801] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:37 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:38.779680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:38.780605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:38.795960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:38.797597 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:38.798818 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:38.801107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:38.801936 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:38.802383 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:38.973723 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:38.983195 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e18d1930-ca35-4992-9dc9-384f97fa18be tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.208352 Aug 24 17:32:38.983797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 368/802] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:38 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:39.485607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:39.486463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:39.496657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:39.497161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:39.497605 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:39.498320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:39.498818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:39.499279 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:39.643314 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lazy-loading 'services' on Instance uuid 483b254a-2178-420a-8a82-111e13dfaa7e {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:32:40.010479 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:40.011123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e8800b78-3c97-4b8b-8673-718777d35152 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "DELETE /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/os-volume_attachments/fa6e4259-64e3-4edc-9b12-89cda13e6777" status: 202 len: 0 microversion: 2.1 time: 0.532025 Aug 24 17:32:40.011952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:40.012109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 435/803] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:32:39 2022] DELETE /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/os-volume_attachments/fa6e4259-64e3-4edc-9b12-89cda13e6777 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:32:40.023906 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:40.024447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:40.025410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:40.026154 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:40.027034 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:40.027438 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:40.174641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:40.192187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-20a517d8-d8f8-4d70-96ec-46f39aec9146 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.190794 Aug 24 17:32:40.192878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 369/804] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:39 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:41.216440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:41.217234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:41.224467 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:41.224967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:41.225408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:41.226111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:41.226571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:41.227090 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:41.385886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:41.394473 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5f0fcf4d-e6a3-4582-a061-11dc2c6b8682 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.183473 Aug 24 17:32:41.395093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 436/805] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:41 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:42.227611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f54b8b65-b312-4074-afdf-afa1d220d308 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:32:42.234421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f54b8b65-b312-4074-afdf-afa1d220d308 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:42.234918 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f54b8b65-b312-4074-afdf-afa1d220d308 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:42.235371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f54b8b65-b312-4074-afdf-afa1d220d308 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:42.298201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f54b8b65-b312-4074-afdf-afa1d220d308 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Going to try to stop instance {{(pid=121010) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:32:42.418173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:42.418771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:42.425469 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:42.429771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:42.429771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:42.429771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:42.429771 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:42.430253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:42.530032 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f54b8b65-b312-4074-afdf-afa1d220d308 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/action" status: 202 len: 0 microversion: 2.1 time: 0.306016 Aug 24 17:32:42.530663 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 370/806] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:32:42 2022] POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:32:42.539656 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:42.540413 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:42.572494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:42.572494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:42.572494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:42.573258 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:42.573377 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:42.573758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:42.585336 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:42.595116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-eab2301a-86aa-4494-8fcf-c30d843a94fd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.180912 Aug 24 17:32:42.595708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 437/807] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:42 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:32:42.735552 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:42.744179 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ceedd6d3-03a9-4e76-ba4a-bf8424dd3e09 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1678 microversion: 2.1 time: 0.208447 Aug 24 17:32:42.744757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 371/808] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:42 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:43.621664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:43.622999 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:43.635065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:43.635736 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:43.636219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:43.637876 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:43.637876 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:43.637876 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:43.767526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:43.768124 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:43.776633 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:43.777152 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:43.777586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:43.778276 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:43.778727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:43.779179 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:43.786049 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:43.795077 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-067bfeae-334b-45f4-abdd-796c391084f3 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.180938 Aug 24 17:32:43.795670 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 438/809] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:43 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:43.928213 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:43.937043 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-60059560-0c9d-4c82-b7fa-2449be0f91be tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1678 microversion: 2.1 time: 0.173720 Aug 24 17:32:43.937629 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 372/810] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:43 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:32:44.748419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:32:44.749025 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Wed Aug 24 17:32:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:32:44.819942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:44.820551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:44.827088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:44.827571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:44.828001 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:44.828795 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:44.829274 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:44.829713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:44.832450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:32:44.958547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:44.959413 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:44.966640 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:44.967164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:44.967602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:44.968298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:44.968745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:44.969170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:44.973941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:44.985888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-642ec983-fed2-4e12-9cce-9a14202a0835 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.169940 Aug 24 17:32:44.986446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 439/811] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:44 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:45.117508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:45.125746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a16bc241-80d0-48d9-8b73-bf3fa9cb3987 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1678 microversion: 2.1 time: 0.171027 Aug 24 17:32:45.126309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 373/812] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:44 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:46.008651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:46.009941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:46.017060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:46.017596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:46.018042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:46.018751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:46.019241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:46.019703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:46.147744 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:46.148388 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:46.155323 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:46.155830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:46.156263 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:46.156975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:46.157715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:46.158149 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:46.167647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:46.177724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-61082fe4-f3ab-4271-9358-0704391c6945 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.173657 Aug 24 17:32:46.178696 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 440/813] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:46 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:46.314266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:46.323407 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e4d43965-20d4-4bb7-bcee-5f4590987d7e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1678 microversion: 2.1 time: 0.179941 Aug 24 17:32:46.324007 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 374/814] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:46 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:47.205836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:47.206596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:47.213872 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:47.214344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:47.214795 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:47.215502 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:47.215956 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:47.216387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:47.345344 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:47.345968 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:47.352600 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:47.353743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:47.354136 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:47.354866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:47.355330 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:47.355759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:47.359809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:47.368229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5056751b-b3e1-4946-95cc-deadabfc8b72 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.166179 Aug 24 17:32:47.368844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 441/815] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:47 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:47.501197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:47.510460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7ee92300-396f-4dfd-9822-555a7e57ea9e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1678 microversion: 2.1 time: 0.168875 Aug 24 17:32:47.511100 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 375/816] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:47 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:32:48.389968 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:48.390578 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:48.398211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:48.398211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:48.398520 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:48.399163 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:48.400252 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:48.400682 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:48.536954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:48.537730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:48.539742 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:48.544581 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:48.545103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:48.545546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:48.546256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:48.546717 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:48.547434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:48.549926 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cbfc8c8a-6b67-4e1b-ba40-d696d8076e47 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.163679 Aug 24 17:32:48.555007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 442/817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:48 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:48.702369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:48.711856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3160458b-25fb-4daa-9c0c-025b036bbbb3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1678 microversion: 2.1 time: 0.178980 Aug 24 17:32:48.712511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 376/818] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:48 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:49.571960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:49.572574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:49.580396 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:49.580880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:49.581313 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:49.582003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:49.582458 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:49.582877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:49.727706 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:49.733380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:49.734231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:49.736374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1b36f551-45cb-4070-963d-161740a8d606 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.168190 Aug 24 17:32:49.736949 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 443/819] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:49 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:49.741299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:49.741861 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:49.742366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:49.743202 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:49.743745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:49.744256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:49.879211 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:49.887477 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-67c83f9f-36c3-46ee-97a1-d1f3977df8bb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1678 microversion: 2.1 time: 0.157973 Aug 24 17:32:49.888048 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 377/820] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:49 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:50.761836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:50.762703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:50.770576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:50.771095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:50.771652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:50.772498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:50.772995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:50.773426 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:50.910465 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:50.911096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:50.919914 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:50.920846 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:50.921391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:50.922111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:50.922576 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:50.923026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:50.966279 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:50.980442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2fd1852e-3022-464b-b811-8384b991472e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.225361 Aug 24 17:32:50.983367 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 444/821] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:50 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:51.097655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:51.107952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1030bbda-0db6-4577-a6ba-5c437cba7c43 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1678 microversion: 2.1 time: 0.201283 Aug 24 17:32:51.108917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 378/822] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:50 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1678 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:32:52.006383 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:52.007018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:52.014209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:52.014690 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:52.015158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:52.015898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:52.016353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:52.016807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:52.132653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:52.133298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:52.140488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:52.140978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:52.141419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:52.142120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:52.142581 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:52.143043 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:52.153033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:52.161506 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f3776ade-bef6-495e-8d53-e25d40e635dd tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.159111 Aug 24 17:32:52.162078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 445/823] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:52 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:52.277451 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:52.286932 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c9044d18-e92c-4dba-a35b-8579c95d9204 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1678 microversion: 2.1 time: 0.158126 Aug 24 17:32:52.287538 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 379/824] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:52 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:32:53.182656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:53.183297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:53.190443 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:53.190963 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:53.191409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:53.192143 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:53.192633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:53.193032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:53.308436 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:53.309298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:53.315937 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:53.316434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:53.316883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:53.317592 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:53.318110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:53.318597 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:53.340140 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:32:53.341230 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:53.350819 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d5f8bbe9-3e5e-4e84-ad1f-6efe1fd8bb2d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.171982 Aug 24 17:32:53.352197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 446/825] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:53 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:53.465221 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:53.472958 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e97561bf-0d0e-42e7-8e92-0fd05614e2a1 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1655 microversion: 2.1 time: 0.169197 Aug 24 17:32:53.473524 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 380/826] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:53 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:53.500503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bbf717ac-57b1-4521-a702-3845a0faacf7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:32:53.506530 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bbf717ac-57b1-4521-a702-3845a0faacf7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:53.508216 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bbf717ac-57b1-4521-a702-3845a0faacf7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:53.508216 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bbf717ac-57b1-4521-a702-3845a0faacf7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:53.537305 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bbf717ac-57b1-4521-a702-3845a0faacf7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Going to try to start instance {{(pid=121011) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:32:53.804927 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bbf717ac-57b1-4521-a702-3845a0faacf7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/action" status: 202 len: 0 microversion: 2.1 time: 0.307950 Aug 24 17:32:53.805729 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 447/827] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:32:53 2022] POST /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:32:53.816444 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:53.817425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:53.824189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:53.824689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:53.825133 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:53.825903 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:53.826363 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:53.826794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:53.985659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:53.994704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72fc63a3-1bea-4d93-8b9d-16a98a233965 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1664 microversion: 2.1 time: 0.183043 Aug 24 17:32:53.995343 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 381/828] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:53 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1664 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:54.373138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:54.373740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:54.380091 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:54.380578 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:54.381014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:54.381710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:54.382159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:54.382576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:54.518407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:54.529980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4f9d8885-251c-4145-a7b1-64d76cabe8f8 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.161135 Aug 24 17:32:54.530569 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 448/829] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:54 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:55.016403 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:55.017008 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:55.024243 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:55.024736 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:55.025229 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:55.025935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:55.026395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:55.026814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:55.162942 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:55.171875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6362cc22-b11a-417c-b363-de55193ab665 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1664 microversion: 2.1 time: 0.159292 Aug 24 17:32:55.172461 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 382/830] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:55 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:55.559097 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:55.559715 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:55.566361 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:55.566862 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:55.567340 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:55.568045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:55.568499 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:55.568932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:55.714174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:55.722530 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-61066992-7b9c-48e1-a4f2-d6138af34b3e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.167446 Aug 24 17:32:55.723251 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 449/831] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:55 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:56.196064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:56.196698 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:56.204754 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:56.205243 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:56.205670 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:56.206369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:56.206822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:56.207266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:56.406519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:56.421128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-82d27f70-ebef-42f6-b08a-25acd01de246 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1664 microversion: 2.1 time: 0.230357 Aug 24 17:32:56.422136 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 383/832] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:56 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1664 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:56.745726 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:56.746462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:56.754373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:56.754787 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:56.755261 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:56.755973 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:56.756435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:56.756863 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:56.909517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:56.919195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ab9f3243-faff-49a2-bf95-15f7b607c64f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.177183 Aug 24 17:32:56.923347 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 450/833] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:56 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:57.449513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:57.450149 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:57.457338 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:57.457756 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:57.458196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:57.458895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:57.459391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:57.459820 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:57.600256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:57.608900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a779ef0e-84a0-4b05-a0f7-f7a85e744b61 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1664 microversion: 2.1 time: 0.164064 Aug 24 17:32:57.609488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 384/834] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:57 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:32:57.761985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:57.762526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:57.769020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:57.769552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:57.769983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:57.770681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:57.771324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:57.771755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:57.801911 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:32:57.945092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:57.946043 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:57.953345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:57.954495 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:57.954669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:57.955519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:57.955991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:57.959057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:58.155572 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-652d871a-ea17-43f9-8b29-fd59477f47b0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "DELETE /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 204 len: 0 microversion: 2.1 time: 0.521330 Aug 24 17:32:58.159732 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 451/835] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:32:57 2022] DELETE /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:32:58.170016 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:58.171069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:58.181812 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:58.184849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:58.184849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:58.184849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:58.185378 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:58.185559 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:58.185760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:58.201805 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-09bddcf6-f5a6-4a9b-80db-446f38e70525 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1736 microversion: 2.1 time: 0.263296 Aug 24 17:32:58.207888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 385/836] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:57 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1736 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:58.355884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:58.375551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-16d83b3d-7039-4601-8303-b9b1494fd71e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1574 microversion: 2.1 time: 0.213161 Aug 24 17:32:58.376570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 452/837] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:58 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:58.634152 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:58.635772 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:58.646878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:58.648014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:58.648718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:58.649514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:58.650026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:58.650472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:58.808159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:58.821949 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0234e1fa-1c09-4b66-8bae-0fdbb04a4438 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1668 microversion: 2.1 time: 0.195126 Aug 24 17:32:58.823133 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 386/838] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:58 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1668 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:59.232586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:59.233405 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:59.241083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.241585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.242046 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:59.242790 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.243280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.243715 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:59.247390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:32:59.398778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:59.408578 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:59.409204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:59.409603 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-13a4e2d7-b98a-42e0-a8bd-b527e649ee66 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1716 microversion: 2.1 time: 0.182653 Aug 24 17:32:59.410197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 453/839] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:59 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1716 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:59.415718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.416738 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.417364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:59.418285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.418865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.419279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:59.492746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:59.493697 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:59.504426 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.505016 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.505522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:59.506388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.506820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.517940 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:59.617961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:32:59.620876 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] HTTP exception thrown: Cannot 'detach_volume' instance d7feb685-67d6-4b7e-be2b-3e07e65391fb while it is in vm_state rescued Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Request method failure captured: Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: DELETE /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments/8fe611b6-cb8b-441a-a2ef-22911e0a991a HTTP/1.1 Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8leyUT8LR9_joBp5WcTRObVQ1206G5ZdQoG9THeHLiJNiHLOsvuazAWZKz1rXGxK2Kq6v_grcLjSgk1PqNuH-i8QeGG2CWBjJ8NnKmRjvoyTk79WH-fY3a7lhqHqbUNdoCRWQYR3F4c3wy8hXHbVz0rp6MFYehuyE9TI0_T4utcag Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:32:59.623965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf9b8b1e5c0f4021ae5f40c11c962222", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 0696e6f707274727b57a9a7493c47664 Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:32:59.625695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Cannot 'detach_volume' instance d7feb685-67d6-4b7e-be2b-3e07e65391fb while it is in vm_state rescued Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'server_id': 'd7feb685-67d6-4b7e-be2b-3e07e65391fb', 'id': '8fe611b6-cb8b-441a-a2ef-22911e0a991a'} Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7feb685-67d6-4b7e-be2b-3e07e65391fb in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:32:59.626699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d7feb685-67d6-4b7e-be2b-3e07e65391fb while it is in vm_state rescued Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d7feb685-67d6-4b7e-be2b-3e07e65391fb while it is in vm_state rescued Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:32:59.628594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Returning 409 to user: Cannot 'detach_volume' instance d7feb685-67d6-4b7e-be2b-3e07e65391fb while it is in vm_state rescued {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:32:59.630055 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-276dc0da-9be8-4fe2-80f8-cfedd225e52a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1574 microversion: 2.1 time: 0.223664 Aug 24 17:32:59.630217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c6a14f6c-9870-4a22-8611-770b9ce4d280 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments/8fe611b6-cb8b-441a-a2ef-22911e0a991a" status: 409 len: 152 microversion: 2.1 time: 0.141528 Aug 24 17:32:59.630370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 387/840] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:59 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:32:59.630526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 454/841] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:32:59 2022] DELETE /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments/8fe611b6-cb8b-441a-a2ef-22911e0a991a => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 17:32:59.639552 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e5bf5190-6343-4a37-b245-0ad2d9656fd0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:32:59.640342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e5bf5190-6343-4a37-b245-0ad2d9656fd0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:59.647535 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5bf5190-6343-4a37-b245-0ad2d9656fd0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.647929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5bf5190-6343-4a37-b245-0ad2d9656fd0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.648376 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5bf5190-6343-4a37-b245-0ad2d9656fd0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:59.649096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5bf5190-6343-4a37-b245-0ad2d9656fd0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.649556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5bf5190-6343-4a37-b245-0ad2d9656fd0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.649988 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e5bf5190-6343-4a37-b245-0ad2d9656fd0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:59.930153 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e5bf5190-6343-4a37-b245-0ad2d9656fd0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "POST /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/action" status: 202 len: 0 microversion: 2.1 time: 0.294868 Aug 24 17:32:59.931172 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 388/842] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:32:59 2022] POST /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:32:59.940018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:32:59.940659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:32:59.948091 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.948810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.949398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:32:59.950113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:32:59.950561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:32:59.951069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:00.111014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:00.120555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fc381438-9cba-4780-8cfd-1ca0201c5e43 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1724 microversion: 2.1 time: 0.184256 Aug 24 17:33:00.121157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 455/843] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:32:59 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:00.653120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:00.653882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:00.660636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:00.661145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:00.661584 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:00.662368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:00.663133 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:00.663712 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:00.893567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:00.909336 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b0751ece-baa5-42c9-a2c9-9242a405eff8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1574 microversion: 2.1 time: 0.262671 Aug 24 17:33:00.911498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 389/844] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:00 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1574 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:01.152390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:01.153221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:01.160173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:01.160604 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:01.161045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:01.161756 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:01.162220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:01.162655 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:01.347989 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:01.358488 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-20ee2ffb-b8f1-4319-8a11-1a096e221e88 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1724 microversion: 2.1 time: 0.211214 Aug 24 17:33:01.359660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 456/845] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:01 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:01.936829 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:01.937437 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:01.944001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:01.944497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:01.944940 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:01.945646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:01.946266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:01.946700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:02.335120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:02.350618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-92b24954-c320-4993-979d-16fac2ccd438 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1574 microversion: 2.1 time: 0.419735 Aug 24 17:33:02.351948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 390/846] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:01 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1574 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:02.382851 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:02.384470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:02.392544 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:02.393039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:02.393476 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:02.394209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:02.394663 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:02.395258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:02.655318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:02.673970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fbef195d-714e-42b7-8890-f107da62831d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1724 microversion: 2.1 time: 0.296128 Aug 24 17:33:02.687230 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 457/847] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:02 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:03.382705 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:03.385336 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:03.393583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:03.394402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:03.395075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:03.395932 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:03.396527 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:03.397086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:03.489447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:03.500829 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-096c7016-5947-425b-8c1d-95696a050518 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1507 microversion: 2.1 time: 0.123120 Aug 24 17:33:03.507448 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 391/848] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:03 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1507 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:03.641021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-b406caeb-18d1-4199-af23-e8bab8555b4c req-36d0ea10-1cc9-4998-b848-399ebf7fad48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028a50e6-e905-4cc5-aaab-ad1dfe279845", "name": "network-vif-deleted", "tag": "5c495910-bb43-41b8-bcdc-3755a81d9cc7"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:03.658641 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-b406caeb-18d1-4199-af23-e8bab8555b4c req-36d0ea10-1cc9-4998-b848-399ebf7fad48 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:03.660632 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-b406caeb-18d1-4199-af23-e8bab8555b4c req-36d0ea10-1cc9-4998-b848-399ebf7fad48 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:03.661412 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-b406caeb-18d1-4199-af23-e8bab8555b4c req-36d0ea10-1cc9-4998-b848-399ebf7fad48 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:03.680549 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-b406caeb-18d1-4199-af23-e8bab8555b4c req-36d0ea10-1cc9-4998-b848-399ebf7fad48 service nova] Creating event network-vif-deleted:5c495910-bb43-41b8-bcdc-3755a81d9cc7 for instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 on hv-cinder-85164 Aug 24 17:33:03.689336 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-b406caeb-18d1-4199-af23-e8bab8555b4c req-36d0ea10-1cc9-4998-b848-399ebf7fad48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055152 Aug 24 17:33:03.699341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 458/849] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:33:03.699447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:03.699447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:03.705940 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:03.706577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:03.707108 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:03.716669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:03.716669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:03.716669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:03.915508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:03.924730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c51db203-324c-4c62-93f6-5c332f4be769 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1724 microversion: 2.1 time: 0.230828 Aug 24 17:33:03.925551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 392/850] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:03 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:04.539850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:04.541308 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:04.553957 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:04.554292 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:04.555181 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:04.557777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:04.559067 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:04.559843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:04.657853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:04.670590 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1d5589c9-d166-4c0f-a28e-db863f1abb5c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1223 microversion: 2.1 time: 0.138832 Aug 24 17:33:04.671466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 459/851] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:04 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:04.959676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:04.960676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:04.974774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:04.975516 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:04.976138 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:04.976871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:04.977336 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:04.977763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:05.141944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:05.150813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7c8dff80-4ca0-471d-960c-73181d343e8f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1724 microversion: 2.1 time: 0.198400 Aug 24 17:33:05.151763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 393/852] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:04 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:05.694416 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:05.695082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:05.701839 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:05.702333 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:05.702773 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:05.703503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:05.703965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:05.704396 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:05.774137 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:05.784067 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-692efd49-967e-4c2b-a07e-5110f9e9eeb2 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1223 microversion: 2.1 time: 0.093454 Aug 24 17:33:05.784657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 460/853] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:05 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:06.172401 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:06.173036 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:06.179961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:06.180482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:06.180979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:06.181709 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:06.182164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:06.182595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:06.318728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:06.327788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5eff019-6223-45af-b122-1b86abd016c7 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1724 microversion: 2.1 time: 0.159500 Aug 24 17:33:06.328352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 394/854] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:06 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:06.804865 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:06.805398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:06.812366 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:06.812852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:06.813289 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:06.813974 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:06.814428 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:06.814986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:06.899235 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:06.907306 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c69b4254-6192-435a-ab41-dcd372f7c16e tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1223 microversion: 2.1 time: 0.106329 Aug 24 17:33:06.907891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 461/855] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:06 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:07.349564 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:07.350180 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:07.352798 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=57 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:07.358450 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:07.358970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:07.359417 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:07.360123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:07.360599 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:07.361599 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:07.516305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:07.525603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-019acc9a-03d1-4efe-978e-0a79ff5fe1f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1724 microversion: 2.1 time: 0.179816 Aug 24 17:33:07.526170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 395/856] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:07 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:07.928638 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:07.929315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:07.931886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:07.936807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:07.937298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:07.937779 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:07.938496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:07.938979 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:07.939420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:07.973203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:07.973689 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:07.974127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:07.974576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lazy-loading 'fault' on Instance uuid 028a50e6-e905-4cc5-aaab-ad1dfe279845 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:33:08.017283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:08.026397 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f4a8cfd5-b072-41c3-bdf1-a019bbcfbc7c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 200 len: 1228 microversion: 2.1 time: 0.101686 Aug 24 17:33:08.027022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 462/857] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:07 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 1228 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:08.551126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:08.552204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:08.560715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:08.561212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:08.561653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:08.562352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:08.562811 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:08.563266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:08.567482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:08.721517 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:08.736387 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae6d39c4-600b-4ec6-becb-3ce0bcce5e07 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1724 microversion: 2.1 time: 0.191368 Aug 24 17:33:08.737483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 396/858] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:08 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:09.049022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:09.049580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:09.057002 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:09.057510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:09.057994 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:09.058689 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:09.059199 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:09.059623 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:09.074210 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] HTTP exception thrown: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Request method failure captured: Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 HTTP/1.1 Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl-EL00gZv5DsF1U7Oj6KHwzWHaWOFjNU9U1pvzlzO8AEaiaDiUDx37iG_TuYtAufLjvxkrdXKUqhf-E55_crSILPBAQ1R1CkR9MACa60CoJx3TMOMqe8bPvE7oaQMcOK1Duupmw9y2vRRrM7ixD-JnWceE8ENh1HOcnUl4CHf_nRCk Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:33:09.075981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_036fc4bf065249e29d0e1e90d23bae19", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 47da700d7d0f4d5cb1ea984a82d643bf Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:33:09.078551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '028a50e6-e905-4cc5-aaab-ad1dfe279845'} Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:33:09.080148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:33:09.082505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:09.084704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Returning 404 to user: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:33:09.084704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-eef58942-f9d5-46aa-815f-d86025c5ceac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 404 len: 111 microversion: 2.1 time: 0.032382 Aug 24 17:33:09.084704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 463/859] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:09 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:33:09.128254 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-568266148", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-898876491", "security_groups": [{"name": "tempest-secgroup-smoke-561477544"}], "block_device_mapping_v2": [{"uuid": "95dad41f-90f2-4662-be14-3b72aea50d23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5acc8120-3236-4503-932d-c28186671d3c"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:09.246660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] validate_networks() for [('5acc8120-3236-4503-932d-c28186671d3c', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:33:09.763472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:09.763973 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:09.770197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:09.771133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:09.771631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:09.772588 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:09.773056 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:09.773482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:09.931540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:33:09.932138 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:33:09.932718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:33:09.933198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:33:09.933689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:33:09.942870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:09.943476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:09.944070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:09.944872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:09.945528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:09.946003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:09.964042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:09.965341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Getting quotas for project 036fc4bf065249e29d0e1e90d23bae19. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:33:09.969468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Getting quotas for user 47da700d7d0f4d5cb1ea984a82d643bf and project 036fc4bf065249e29d0e1e90d23bae19. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:33:09.972666 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f7bf2b00-a2d1-46cf-a2dd-21469b9de9fa tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1730 microversion: 2.1 time: 0.213438 Aug 24 17:33:09.973227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 464/860] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:09 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:09.994431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e1460737-7b4d-416a-842b-448d01ba31df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:09.994961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e1460737-7b4d-416a-842b-448d01ba31df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:10.002339 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e1460737-7b4d-416a-842b-448d01ba31df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:10.002836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e1460737-7b4d-416a-842b-448d01ba31df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:10.003313 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e1460737-7b4d-416a-842b-448d01ba31df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:10.004047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e1460737-7b4d-416a-842b-448d01ba31df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:10.004511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e1460737-7b4d-416a-842b-448d01ba31df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:10.004959 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e1460737-7b4d-416a-842b-448d01ba31df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:10.030990 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:33:10.033310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95dad41f-90f2-4662-be14-3b72aea50d23',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:33:10.086940 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e1460737-7b4d-416a-842b-448d01ba31df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096545 Aug 24 17:33:10.087539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 465/861] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 24 17:33:09 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:33:10.553075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72b86bcc-e4cc-478a-b1b8-327739526480 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.428402 Aug 24 17:33:10.565349 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 397/862] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:33:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:33:10.565663 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9f989d27-3dfb-4989-94c5-d890aee81e67 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:10.566191 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9f989d27-3dfb-4989-94c5-d890aee81e67 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:10.640000 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9f989d27-3dfb-4989-94c5-d890aee81e67 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:10.647659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9f989d27-3dfb-4989-94c5-d890aee81e67 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1093 microversion: 2.1 time: 0.086229 Aug 24 17:33:10.648238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 466/863] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:10 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1093 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:11.108698 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-7c5207bf-d8c6-4b68-b08a-9c39855a8e77 req-dad6b99a-7a23-4df3-aa33-38cf0f48b9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7feb685-67d6-4b7e-be2b-3e07e65391fb", "tag": "67636d15-fa82-4271-bc02-ed3ff53fee97"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:11.120337 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7c5207bf-d8c6-4b68-b08a-9c39855a8e77 req-dad6b99a-7a23-4df3-aa33-38cf0f48b9da service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:11.121101 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7c5207bf-d8c6-4b68-b08a-9c39855a8e77 req-dad6b99a-7a23-4df3-aa33-38cf0f48b9da service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:11.121641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-7c5207bf-d8c6-4b68-b08a-9c39855a8e77 req-dad6b99a-7a23-4df3-aa33-38cf0f48b9da service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:11.134038 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-7c5207bf-d8c6-4b68-b08a-9c39855a8e77 req-dad6b99a-7a23-4df3-aa33-38cf0f48b9da service nova] Creating event network-changed:67636d15-fa82-4271-bc02-ed3ff53fee97 for instance d7feb685-67d6-4b7e-be2b-3e07e65391fb on hv-cinder-85164 Aug 24 17:33:11.139988 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-7c5207bf-d8c6-4b68-b08a-9c39855a8e77 req-dad6b99a-7a23-4df3-aa33-38cf0f48b9da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036685 Aug 24 17:33:11.140759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 398/864] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:11.680329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:11.681418 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:11.692397 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:11.693193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:11.693818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:11.694794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:11.695466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:11.696146 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:11.795359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:11.809854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-df269729-4f10-4f3f-8928-d54f5549ff84 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1143 microversion: 2.1 time: 0.139427 Aug 24 17:33:11.810446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 467/865] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:11 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1143 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:12.762895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e2ce0f3-8531-4c05-a290-1dcfa0a4d630 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:12.765286 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e2ce0f3-8531-4c05-a290-1dcfa0a4d630 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:12.771796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e2ce0f3-8531-4c05-a290-1dcfa0a4d630 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:12.772294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e2ce0f3-8531-4c05-a290-1dcfa0a4d630 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:12.772995 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e2ce0f3-8531-4c05-a290-1dcfa0a4d630 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:12.773700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e2ce0f3-8531-4c05-a290-1dcfa0a4d630 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:12.774185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e2ce0f3-8531-4c05-a290-1dcfa0a4d630 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:12.774613 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e2ce0f3-8531-4c05-a290-1dcfa0a4d630 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:12.831226 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:12.832582 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:12.839983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:12.840480 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:12.840974 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:12.841638 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:12.842113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:12.842526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:12.919477 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:12.927344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-618da61a-be1d-4235-9d90-c95cca4dd152 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1191 microversion: 2.1 time: 0.099909 Aug 24 17:33:12.927918 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 468/866] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:12 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:13.100700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e2ce0f3-8531-4c05-a290-1dcfa0a4d630 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "POST /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/action" status: 202 len: 0 microversion: 2.1 time: 0.345307 Aug 24 17:33:13.101389 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 399/867] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:33:12 2022] POST /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:33:13.112423 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:13.113066 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:13.119865 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:13.120351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:13.120784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:13.121486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:13.121932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:13.122350 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:13.167203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-3a6dc599-19f0-4801-a28e-46601f4a221b req-885b161d-c7e8-4963-b31b-56172935c009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7feb685-67d6-4b7e-be2b-3e07e65391fb", "tag": "67636d15-fa82-4271-bc02-ed3ff53fee97"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:13.180875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3a6dc599-19f0-4801-a28e-46601f4a221b req-885b161d-c7e8-4963-b31b-56172935c009 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:13.182285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3a6dc599-19f0-4801-a28e-46601f4a221b req-885b161d-c7e8-4963-b31b-56172935c009 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:13.183159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-3a6dc599-19f0-4801-a28e-46601f4a221b req-885b161d-c7e8-4963-b31b-56172935c009 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:13.206947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-3a6dc599-19f0-4801-a28e-46601f4a221b req-885b161d-c7e8-4963-b31b-56172935c009 service nova] Creating event network-changed:67636d15-fa82-4271-bc02-ed3ff53fee97 for instance d7feb685-67d6-4b7e-be2b-3e07e65391fb on hv-cinder-85164 Aug 24 17:33:13.215429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-3a6dc599-19f0-4801-a28e-46601f4a221b req-885b161d-c7e8-4963-b31b-56172935c009 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053398 Aug 24 17:33:13.216246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 400/868] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:33:13.449666 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:13.458695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5f5f21f7-c30f-42c4-93ba-0840334c9cbf tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1752 microversion: 2.1 time: 0.351867 Aug 24 17:33:13.466477 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 469/869] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:13 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1752 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:13.950485 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:13.951943 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:13.958627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:13.959368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:13.959815 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:13.960538 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:13.961260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:13.961798 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:14.039146 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:14.054719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a3a8ce97-d5fc-4771-a4e7-d5d97a262767 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1209 microversion: 2.1 time: 0.108992 Aug 24 17:33:14.056175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 401/870] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:13 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:14.481177 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:14.482447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:14.491969 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:14.492639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:14.493083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:14.494611 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:14.494946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:14.495574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:14.722577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:14.733444 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-91ac47c7-33ba-4423-b81f-5b8220124ca9 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1752 microversion: 2.1 time: 0.256525 Aug 24 17:33:14.748385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 470/871] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:14 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1752 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:15.083240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:15.084052 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:15.091375 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:15.091875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:15.092304 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:15.093004 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:15.093454 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:15.093894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:15.336787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:15.350928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9346b3f8-390f-487d-9a6c-0e2142bca175 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1276 microversion: 2.1 time: 0.272876 Aug 24 17:33:15.351727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 402/872] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:15 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1276 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:15.650994 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-856b4184-f30c-42ce-9f30-089e63989b19 req-c88aef79-ce1a-47af-8563-6b8b46d0d882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990e4d74-6e7f-42f6-a003-c1a3e2f52449", "tag": "2f546386-f9b9-44c0-8328-7aca5bef1800"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:15.662938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-856b4184-f30c-42ce-9f30-089e63989b19 req-c88aef79-ce1a-47af-8563-6b8b46d0d882 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:15.663443 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-856b4184-f30c-42ce-9f30-089e63989b19 req-c88aef79-ce1a-47af-8563-6b8b46d0d882 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:15.664229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-856b4184-f30c-42ce-9f30-089e63989b19 req-c88aef79-ce1a-47af-8563-6b8b46d0d882 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:15.679164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-856b4184-f30c-42ce-9f30-089e63989b19 req-c88aef79-ce1a-47af-8563-6b8b46d0d882 service nova] Creating event network-changed:2f546386-f9b9-44c0-8328-7aca5bef1800 for instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 on hv-cinder-85164 Aug 24 17:33:15.685965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-856b4184-f30c-42ce-9f30-089e63989b19 req-c88aef79-ce1a-47af-8563-6b8b46d0d882 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039511 Aug 24 17:33:15.686574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 471/873] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:33:15.759115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:15.760415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:15.768033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:15.768673 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:15.769474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:15.770499 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:15.771133 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:15.771817 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:16.049199 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:16.058166 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2ade21cd-632a-4dd0-bc71-8bec0a50a9c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.303100 Aug 24 17:33:16.058754 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 403/874] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:15 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:16.372709 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:16.373410 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:16.379904 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:16.380397 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:16.380885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:16.381593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:16.382045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:16.382471 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:16.606748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:16.610451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:16.621054 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-de4818a9-bf84-4e49-a2aa-4bcd2ab669bb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.252738 Aug 24 17:33:16.622080 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 472/875] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:16 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:17.082581 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:17.083414 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:17.090712 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:17.091242 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:17.091811 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:17.100540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:17.100540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:17.100540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:17.261136 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:17.272219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fb49e72e-e50a-4353-9eb1-74e0d7a8e32c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.194053 Aug 24 17:33:17.273067 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 404/876] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:17 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:17.642329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:17.643023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:17.653658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:17.654154 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:17.654593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:17.655379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:17.655843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:17.656298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:17.814573 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:17.823577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-635bd7be-6fb8-4d88-8099-ed1cbdfc7bdd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.185267 Aug 24 17:33:17.824166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 473/877] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:17 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:18.299334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:18.300394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:18.311066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:18.311753 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:18.312286 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:18.313034 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:18.313493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:18.313923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:18.478650 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:18.487991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8eccd621-7306-4ccf-80d8-db2a6ec9aeb4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.196048 Aug 24 17:33:18.488705 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 405/878] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:18 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:18.850593 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:18.851600 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:18.861777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:18.862564 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:18.863253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:18.864206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:18.864841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:18.865447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:19.011528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:19.019615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-be5f0a29-ed6f-4868-acbc-34f1c6c36b3b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.175977 Aug 24 17:33:19.020202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 474/879] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:18 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:19.510593 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:19.511635 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:19.518267 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:19.518744 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:19.519364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:19.520542 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:19.521271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:19.521706 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:19.700920 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:19.709501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-79db41aa-0947-4ebb-9ac9-d5b183ae439e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.203739 Aug 24 17:33:19.710068 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 406/880] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:19 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:20.043437 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:20.044063 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:20.050814 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:20.051320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:20.051751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:20.052439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:20.052892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:20.053348 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:20.214159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:20.222052 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1c438d8f-75bd-427c-9c3f-224ab48412ac tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.184311 Aug 24 17:33:20.222640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 475/881] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:20 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:20.742982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:20.744554 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:20.746260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:20.747019 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:20.752893 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:20.755396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:20.755396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:20.755396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:20.755396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:20.755777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:20.936401 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:20.945586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad03aac1-9ef7-418f-958e-ec9184d313af tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.208004 Aug 24 17:33:20.948272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 407/882] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:20 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:21.245860 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:21.246546 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:21.248838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:21.254426 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:21.254997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:21.255601 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:21.256330 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:21.256833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:21.257369 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:21.415350 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:21.431348 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-17f70f91-5d4a-422f-a155-88a24e5fcc91 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.191410 Aug 24 17:33:21.435359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 476/883] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:21 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:21.967416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:21.968238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:21.974778 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:21.975312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:21.975748 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:21.976444 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:21.976900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:21.977315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:22.416728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:22.432252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3c7c5486-87ed-4ab1-8cda-c04a921c28d0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.468026 Aug 24 17:33:22.435017 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 408/884] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:21 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:22.464015 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:22.464627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:22.470692 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:22.471318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:22.471758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:22.472452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:22.472909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:22.473336 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:22.618826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:22.627201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-323af08e-9cf3-4667-b5df-c58ecbbfe8b1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.167628 Aug 24 17:33:22.627779 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 477/885] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:22 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:23.467647 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:23.468421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:23.475486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:23.475967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:23.476404 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:23.477092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:23.477542 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:23.477960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:23.657877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:23.658953 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:23.666584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:23.667301 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:23.667875 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:23.668714 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:23.669274 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:23.669796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:23.683793 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:23.698262 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-53bef9c2-0c90-426f-9a81-8ff33982b6a3 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.236247 Aug 24 17:33:23.699151 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 409/886] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:23 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:23.823661 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:23.832869 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-344de7c8-ea8e-459e-b44e-e2b878f7e9b4 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.180383 Aug 24 17:33:23.833458 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 478/887] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:23 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:24.725511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:24.727727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:24.735168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:24.735660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:24.736098 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:24.736794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:24.737249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:24.737680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:24.865998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:24.866802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:24.874208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:24.874693 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:24.876587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:24.876587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:24.876587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:24.877071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:24.908713 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:24.923268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-923a266f-aa72-40a9-bd16-b89b9350e951 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.206605 Aug 24 17:33:24.924546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 410/888] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:24 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:25.044975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:25.057761 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4d9298c9-a259-4bba-9d08-842b24d8533c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.197871 Aug 24 17:33:25.058733 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 479/889] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:24 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:25.949966 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:25.950845 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:25.958169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:25.958668 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:25.959151 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:25.959851 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:25.960303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:25.960728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:26.097594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:26.098683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:26.108196 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:26.109016 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:26.109538 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:26.110557 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:26.111204 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:26.111793 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:26.130743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:26.144901 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-431c5122-7d7b-42c5-a9a0-f9aeb33cb524 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.198703 Aug 24 17:33:26.145500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 411/890] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:25 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:26.297638 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:26.312432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0acc57b5-a0b1-45b8-acc7-0cb653e99b7a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.219293 Aug 24 17:33:26.313447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 480/891] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:26 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:27.173075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:27.174216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:27.186366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.187293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.188198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.189725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.190562 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.191451 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.335833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:27.336623 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:27.344401 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.344811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.345450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.346333 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.346790 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.347315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.380207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:27.395799 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a1026ce-357e-4c27-b3d6-60a45a80bf3e tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.230422 Aug 24 17:33:27.396968 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 412/892] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:27 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:27.521621 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a7e0b0a-ce4b-4712-a06a-a98d34140887 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:27.522176 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a7e0b0a-ce4b-4712-a06a-a98d34140887 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:27.530685 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:27.532162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7e0b0a-ce4b-4712-a06a-a98d34140887 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.532682 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7e0b0a-ce4b-4712-a06a-a98d34140887 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.533330 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7e0b0a-ce4b-4712-a06a-a98d34140887 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.534372 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7e0b0a-ce4b-4712-a06a-a98d34140887 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.535069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7e0b0a-ce4b-4712-a06a-a98d34140887 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.535719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a7e0b0a-ce4b-4712-a06a-a98d34140887 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.543958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-78fdb721-8dc1-4a15-9a23-d637ba469b60 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.211754 Aug 24 17:33:27.545122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 481/893] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:27 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:27.568250 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a7e0b0a-ce4b-4712-a06a-a98d34140887 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1/ips" status: 200 len: 149 microversion: 2.1 time: 0.050965 Aug 24 17:33:27.568987 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 413/894] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:33:27 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:33:27.584472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5171e24d-f578-4d15-b6fc-33f4751d450e"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:27.586848 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:27.594204 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.594767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.595158 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.595865 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.596609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.597036 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.711922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Invalid volume: volume 5171e24d-f578-4d15-b6fc-33f4751d450e is already attached to instances: 95b97103-4f8f-4e11-aadd-a589dac7490e Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: POST /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1/os-volume_attachments HTTP/1.1 Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 74 Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:33:27.713898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {"volumeAttachment": {"volumeId": "5171e24d-f578-4d15-b6fc-33f4751d450e"}} Aug 24 17:33:27.716955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Invalid volume: volume 5171e24d-f578-4d15-b6fc-33f4751d450e is already attached to instances: 95b97103-4f8f-4e11-aadd-a589dac7490e Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'server_id': '86633f37-ebff-41dd-b6e6-2ece18437ab1', 'body': {'volumeAttachment': {'volumeId': '5171e24d-f578-4d15-b6fc-33f4751d450e'}}} Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5171e24d-f578-4d15-b6fc-33f4751d450e is already attached to instances: 95b97103-4f8f-4e11-aadd-a589dac7490e Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:27.718822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5171e24d-f578-4d15-b6fc-33f4751d450e is already attached to instances: 95b97103-4f8f-4e11-aadd-a589dac7490e Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:27.721503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:27.724003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:27.724003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:33:27.724003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:33:27.724003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5171e24d-f578-4d15-b6fc-33f4751d450e is already attached to instances: 95b97103-4f8f-4e11-aadd-a589dac7490e Aug 24 17:33:27.724003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:27.724003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 400 to user: Invalid volume: volume 5171e24d-f578-4d15-b6fc-33f4751d450e is already attached to instances: 95b97103-4f8f-4e11-aadd-a589dac7490e {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:33:27.724003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cc1ae583-ecad-44a2-824b-13c8877bbe5a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.138574 Aug 24 17:33:27.724003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 482/895] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:33:27 2022] POST /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:33:27.732088 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:27.733020 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:27.745601 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.746469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.747305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.748644 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:27.749481 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:27.750266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:27.757696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:27.796690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:33:28.174124 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-25d372f3-690e-43e0-af40-4d5f1d31838b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 204 len: 0 microversion: 2.1 time: 0.449088 Aug 24 17:33:28.175353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 414/896] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:33:27 2022] DELETE /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:33:28.186156 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:28.187402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:28.199561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:28.203512 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:28.203512 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:28.203774 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:28.204236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:28.204678 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:28.382169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:28.391828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ff79532c-1aca-40db-b6c1-d87c5adf4de7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1680 microversion: 2.1 time: 0.210559 Aug 24 17:33:28.392435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 483/897] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:28 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:28.430503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:28.432460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:28.441721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:28.442316 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:28.442885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:28.443861 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:28.444628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:28.445184 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:28.568203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:28.568203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:28.574779 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:28.575341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:28.575787 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:28.576503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:28.576972 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:28.577404 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:28.655952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:28.669974 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cd8bd325-4f52-4e3f-b63c-ac7e6739fffb tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.245826 Aug 24 17:33:28.678959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 415/898] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:28 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:28.763656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:28.778069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-66a760c0-c64a-4040-9a26-a65f798fa98d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.215265 Aug 24 17:33:28.778664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 484/899] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:28 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:29.416144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:29.416863 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:29.423347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:29.423849 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:29.424294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:29.425014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:29.425474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:29.425909 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:29.597583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:29.606373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c1e1f711-9660-4b98-ad1f-64ab601291bf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1680 microversion: 2.1 time: 0.194650 Aug 24 17:33:29.606995 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 416/900] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:29 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:29.692408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:29.692981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:29.700678 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:29.701297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:29.701738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:29.702440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:29.702890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:29.703340 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:29.802759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:29.804137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:29.814612 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:29.815421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:29.815959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:29.817078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:29.817543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:29.817978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:29.922926 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:29.932029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6a85582b-a448-4054-a64b-a63254eb157a tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.244086 Aug 24 17:33:29.943634 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 485/901] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:29 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:30.003695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:30.013043 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cce652f6-0c24-4b38-89d5-ee295b9e6e59 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.216656 Aug 24 17:33:30.013691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 417/902] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:29 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:30.189279 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-23d368ee-7adb-451d-895b-47013e88638d req-dbf11f43-245c-48d7-9bed-de5b9abdfe35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990e4d74-6e7f-42f6-a003-c1a3e2f52449", "name": "network-vif-plugged", "status": "completed", "tag": "2f546386-f9b9-44c0-8328-7aca5bef1800"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:30.204392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-23d368ee-7adb-451d-895b-47013e88638d req-dbf11f43-245c-48d7-9bed-de5b9abdfe35 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:30.204877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-23d368ee-7adb-451d-895b-47013e88638d req-dbf11f43-245c-48d7-9bed-de5b9abdfe35 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:30.205304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-23d368ee-7adb-451d-895b-47013e88638d req-dbf11f43-245c-48d7-9bed-de5b9abdfe35 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:30.218948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-23d368ee-7adb-451d-895b-47013e88638d req-dbf11f43-245c-48d7-9bed-de5b9abdfe35 service nova] Creating event network-vif-plugged:2f546386-f9b9-44c0-8328-7aca5bef1800 for instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 on hv-cinder-85164 Aug 24 17:33:30.224404 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-23d368ee-7adb-451d-895b-47013e88638d req-dbf11f43-245c-48d7-9bed-de5b9abdfe35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042341 Aug 24 17:33:30.225023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 486/903] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:30.634445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:30.635105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:30.642228 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:30.642754 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:30.643304 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:30.644105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:30.644480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:30.644914 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:30.808621 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:30.826506 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50400c92-a1c4-469e-9578-56359533d80b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1680 microversion: 2.1 time: 0.196023 Aug 24 17:33:30.827305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 418/904] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:30 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:30.960276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:30.961276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:30.969108 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:30.969650 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:30.970316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:30.971209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:30.971792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:30.972254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:31.034975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:31.036082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:31.043295 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:31.043883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:31.044493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:31.046187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:31.046776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:31.047332 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:31.265121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:31.276296 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6e574107-5d47-4e22-9a91-4b6c1c0ef445 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1757 microversion: 2.1 time: 0.322362 Aug 24 17:33:31.276883 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 487/905] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:30 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1757 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:31.303792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:31.313910 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3e65a06a-130f-42a6-b54c-720e4a8156e0 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.282914 Aug 24 17:33:31.314500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 419/906] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:31 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:31.850148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:31.851200 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:31.859133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:31.859717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:31.860256 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:31.861075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:31.861717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:31.862335 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:32.104661 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:32.113067 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d0b13718-4b2c-4096-8ef6-95edb7b87599 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1680 microversion: 2.1 time: 0.267509 Aug 24 17:33:32.113665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 488/907] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:31 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1680 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:32.310352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:32.310994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:32.317764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:32.318255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:32.318690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:32.319513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:32.319874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:32.320293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:32.338864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:32.339822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:32.346292 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:32.346673 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:32.347559 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:32.348678 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:32.349418 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:32.350357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:32.619369 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:32.628574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-94fdd64b-709a-4107-bdd2-04c354f7ec32 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.288792 Aug 24 17:33:32.628938 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:32.641700 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 489/908] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:32 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:32.643691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d05eefb4-4357-443e-aa29-01cdb8beefd2 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1760 microversion: 2.1 time: 0.337370 Aug 24 17:33:32.644841 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 420/909] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:32 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1760 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:32.952393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-c282198e-6a1e-41e9-b41f-c86de2136b3b req-9b05eec7-b320-483b-a51c-e62fb6c462a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86633f37-ebff-41dd-b6e6-2ece18437ab1", "name": "network-vif-deleted", "tag": "994fe834-85b7-4f02-9b3f-7a5091c552f2"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:32.963518 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-c282198e-6a1e-41e9-b41f-c86de2136b3b req-9b05eec7-b320-483b-a51c-e62fb6c462a7 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:32.964048 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-c282198e-6a1e-41e9-b41f-c86de2136b3b req-9b05eec7-b320-483b-a51c-e62fb6c462a7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:32.964472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-c282198e-6a1e-41e9-b41f-c86de2136b3b req-9b05eec7-b320-483b-a51c-e62fb6c462a7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:32.967582 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:32.978080 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-c282198e-6a1e-41e9-b41f-c86de2136b3b req-9b05eec7-b320-483b-a51c-e62fb6c462a7 service nova] Creating event network-vif-deleted:994fe834-85b7-4f02-9b3f-7a5091c552f2 for instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 on hv-cinder-85164 Aug 24 17:33:32.984598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-c282198e-6a1e-41e9-b41f-c86de2136b3b req-9b05eec7-b320-483b-a51c-e62fb6c462a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035395 Aug 24 17:33:32.984947 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 490/910] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:33:33.143604 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:33.144095 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:33.152605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:33.153164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:33.153614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:33.154329 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:33.155026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:33.155459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:33.233447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:33.243509 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-495e4af9-a905-4226-8ecb-1c4a02c7cf8a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1612 microversion: 2.1 time: 0.105066 Aug 24 17:33:33.244981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 421/911] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:33 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1612 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:33.653174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:33.654193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:33.662767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:33.666169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:33.666169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:33.666169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:33.666169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:33.666811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:33.828763 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:33.838932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8ed3da11-63de-4684-9bde-d4fe2c6df507 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1264 microversion: 2.1 time: 0.193168 Aug 24 17:33:33.839992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 491/912] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:33 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:34.271058 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:34.272325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:34.284386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:34.284900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:34.285341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:34.286059 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:34.286576 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:34.287042 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:34.325961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:34.327767 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:34.327767 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:34.327767 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lazy-loading 'fault' on Instance uuid 86633f37-ebff-41dd-b6e6-2ece18437ab1 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:33:34.379834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:34.394337 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0af4e065-aba6-4cd6-9e0e-57d8fd4c6112 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 200 len: 1330 microversion: 2.1 time: 0.130200 Aug 24 17:33:34.395401 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 422/913] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:34 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 1330 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:34.866193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:34.866832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:34.875456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:34.875944 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:34.876387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:34.877075 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:34.877526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:34.877945 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:35.037260 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:35.045261 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5ec27cfa-4a6c-4650-861e-ff6d0ccc0ebd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1450 microversion: 2.1 time: 0.182970 Aug 24 17:33:35.045899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 492/914] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:34 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:35.073743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:35.075806 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:35.083224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:35.083722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:35.084162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:35.084872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:35.085327 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:35.085759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:35.244238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:35.254177 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-db4e3328-1d58-4d54-b5c4-e06a46195811 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1450 microversion: 2.1 time: 0.185743 Aug 24 17:33:35.254177 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 423/915] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:35 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:35.428995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:35.429871 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:35.437098 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:35.439740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:35.439740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:35.439740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:35.440251 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:35.440549 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:35.458190 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 HTTP/1.1 Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:33:35.459899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:33:35.461323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '86633f37-ebff-41dd-b6e6-2ece18437ab1'} Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:33:35.462100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:33:35.470102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:35.474341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:33:35.474341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8bada9ae-f70c-421f-9619-4c5ae93d33cb tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 404 len: 111 microversion: 2.1 time: 0.039112 Aug 24 17:33:35.474341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 493/916] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:35 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:33:35.474804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5b432e0-1f3d-48e2-91c4-faa143655c4f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '.version_select at 0x7f3f23e078b0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:35.558777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5b432e0-1f3d-48e2-91c4-faa143655c4f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646865061" status: 202 len: 0 microversion: 2.1 time: 0.091479 Aug 24 17:33:35.561288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 424/917] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 24 17:33:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646865061 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:33:36.717624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0af40f16-ae50-412c-b5c9-e78eb6f3a642 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:36.718393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0af40f16-ae50-412c-b5c9-e78eb6f3a642 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:36.726069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0af40f16-ae50-412c-b5c9-e78eb6f3a642 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:36.726721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0af40f16-ae50-412c-b5c9-e78eb6f3a642 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:36.727200 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0af40f16-ae50-412c-b5c9-e78eb6f3a642 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:36.727943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0af40f16-ae50-412c-b5c9-e78eb6f3a642 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:36.728967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0af40f16-ae50-412c-b5c9-e78eb6f3a642 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:36.731099 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0af40f16-ae50-412c-b5c9-e78eb6f3a642 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:36.760711 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0af40f16-ae50-412c-b5c9-e78eb6f3a642 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments/37076c1c-33ad-4ecb-9891-79fdbbca2cb3" status: 200 len: 194 microversion: 2.20 time: 0.047096 Aug 24 17:33:36.761324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 494/918] 10.222.0.18 () {60 vars in 1454 bytes} [Wed Aug 24 17:33:36 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments/37076c1c-33ad-4ecb-9891-79fdbbca2cb3 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:36.851727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:36.852497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:36.861452 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:36.862236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:36.862666 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:36.863410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:36.863867 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:36.864290 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:36.996066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lazy-loading 'services' on Instance uuid 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:33:37.273816 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:37.274624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:37.284040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:37.284561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:37.285003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:37.285727 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:37.286213 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:37.286609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:37.303265 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6895776e-fe62-4de7-bc30-29acdcf39d36 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments/37076c1c-33ad-4ecb-9891-79fdbbca2cb3" status: 202 len: 0 microversion: 2.20 time: 0.458320 Aug 24 17:33:37.305148 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 425/919] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Aug 24 17:33:36 2022] DELETE /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments/37076c1c-33ad-4ecb-9891-79fdbbca2cb3 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:33:37.328996 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-840456ce-f2ab-4f4b-801e-03346e0cbfaa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:37.333419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-840456ce-f2ab-4f4b-801e-03346e0cbfaa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:37.348412 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-840456ce-f2ab-4f4b-801e-03346e0cbfaa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:37.349294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-840456ce-f2ab-4f4b-801e-03346e0cbfaa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:37.350074 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-840456ce-f2ab-4f4b-801e-03346e0cbfaa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:37.351358 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-840456ce-f2ab-4f4b-801e-03346e0cbfaa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:37.352246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-840456ce-f2ab-4f4b-801e-03346e0cbfaa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:37.353024 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-840456ce-f2ab-4f4b-801e-03346e0cbfaa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:37.391274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-840456ce-f2ab-4f4b-801e-03346e0cbfaa tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074865 Aug 24 17:33:37.391887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 426/920] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 24 17:33:37 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:37.411802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lazy-loading 'services' on Instance uuid 95b97103-4f8f-4e11-aadd-a589dac7490e {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:33:37.711139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-146995e0-3033-4955-bec6-689ebbccdbb1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments/5171e24d-f578-4d15-b6fc-33f4751d450e" status: 202 len: 0 microversion: 2.1 time: 0.449205 Aug 24 17:33:37.713181 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 495/921] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:33:37 2022] DELETE /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments/5171e24d-f578-4d15-b6fc-33f4751d450e => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:33:37.723500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cba29b3a-1c14-4038-8c0c-9963616d0805 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:37.726127 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cba29b3a-1c14-4038-8c0c-9963616d0805 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:37.728432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:37.734588 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cba29b3a-1c14-4038-8c0c-9963616d0805 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:37.735486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cba29b3a-1c14-4038-8c0c-9963616d0805 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:37.736007 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cba29b3a-1c14-4038-8c0c-9963616d0805 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:37.736829 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cba29b3a-1c14-4038-8c0c-9963616d0805 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:37.737368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cba29b3a-1c14-4038-8c0c-9963616d0805 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:37.737871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cba29b3a-1c14-4038-8c0c-9963616d0805 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:37.787381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cba29b3a-1c14-4038-8c0c-9963616d0805 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065780 Aug 24 17:33:37.788360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 427/922] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:33:37 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:38.376248 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-a5d8cf76-ad27-4e89-acaa-30800e68a337 req-18ba9790-77f5-4dc5-9964-8304be7d1698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990e4d74-6e7f-42f6-a003-c1a3e2f52449", "tag": "2f546386-f9b9-44c0-8328-7aca5bef1800"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:38.381677 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=72 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:38.388051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a5d8cf76-ad27-4e89-acaa-30800e68a337 req-18ba9790-77f5-4dc5-9964-8304be7d1698 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:38.388809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a5d8cf76-ad27-4e89-acaa-30800e68a337 req-18ba9790-77f5-4dc5-9964-8304be7d1698 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:38.389292 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a5d8cf76-ad27-4e89-acaa-30800e68a337 req-18ba9790-77f5-4dc5-9964-8304be7d1698 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:38.405114 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b57abfc-26fd-4ac2-9d56-53b521df87b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:38.407318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b57abfc-26fd-4ac2-9d56-53b521df87b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:38.412396 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-a5d8cf76-ad27-4e89-acaa-30800e68a337 req-18ba9790-77f5-4dc5-9964-8304be7d1698 service nova] Creating event network-changed:2f546386-f9b9-44c0-8328-7aca5bef1800 for instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 on hv-cinder-85164 Aug 24 17:33:38.419642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-a5d8cf76-ad27-4e89-acaa-30800e68a337 req-18ba9790-77f5-4dc5-9964-8304be7d1698 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132814 Aug 24 17:33:38.423964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 496/923] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:38.426807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b57abfc-26fd-4ac2-9d56-53b521df87b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:38.427334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b57abfc-26fd-4ac2-9d56-53b521df87b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:38.431109 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b57abfc-26fd-4ac2-9d56-53b521df87b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:38.432542 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b57abfc-26fd-4ac2-9d56-53b521df87b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:38.433219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b57abfc-26fd-4ac2-9d56-53b521df87b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:38.436280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b57abfc-26fd-4ac2-9d56-53b521df87b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:38.472177 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b57abfc-26fd-4ac2-9d56-53b521df87b5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070697 Aug 24 17:33:38.473224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 428/924] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 24 17:33:38 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:33:38.804547 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3ed4f10a-20a0-43a3-b3e3-25ba43446b76 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:38.808400 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3ed4f10a-20a0-43a3-b3e3-25ba43446b76 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:38.815495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ed4f10a-20a0-43a3-b3e3-25ba43446b76 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:38.815998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ed4f10a-20a0-43a3-b3e3-25ba43446b76 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:38.816635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ed4f10a-20a0-43a3-b3e3-25ba43446b76 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:38.817346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ed4f10a-20a0-43a3-b3e3-25ba43446b76 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:38.817967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ed4f10a-20a0-43a3-b3e3-25ba43446b76 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:38.818574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ed4f10a-20a0-43a3-b3e3-25ba43446b76 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:38.887994 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3ed4f10a-20a0-43a3-b3e3-25ba43446b76 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090283 Aug 24 17:33:38.889915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 497/925] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:33:38 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:39.490753 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de84efc9-3d6e-44c9-97e0-65ede29d2b60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:39.494763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de84efc9-3d6e-44c9-97e0-65ede29d2b60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:39.504439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de84efc9-3d6e-44c9-97e0-65ede29d2b60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:39.504896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de84efc9-3d6e-44c9-97e0-65ede29d2b60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:39.505358 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de84efc9-3d6e-44c9-97e0-65ede29d2b60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:39.509309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de84efc9-3d6e-44c9-97e0-65ede29d2b60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:39.509309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de84efc9-3d6e-44c9-97e0-65ede29d2b60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:39.509309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de84efc9-3d6e-44c9-97e0-65ede29d2b60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:39.511534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:39.542028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de84efc9-3d6e-44c9-97e0-65ede29d2b60 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058571 Aug 24 17:33:39.542617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 429/926] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 24 17:33:39 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:33:39.904529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e17e13c4-e25c-4b69-a14b-9c5e1b5659c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:39.906791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e17e13c4-e25c-4b69-a14b-9c5e1b5659c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:39.913412 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17e13c4-e25c-4b69-a14b-9c5e1b5659c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:39.913903 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17e13c4-e25c-4b69-a14b-9c5e1b5659c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:39.914332 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17e13c4-e25c-4b69-a14b-9c5e1b5659c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:39.915057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17e13c4-e25c-4b69-a14b-9c5e1b5659c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:39.915589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17e13c4-e25c-4b69-a14b-9c5e1b5659c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:39.916022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e17e13c4-e25c-4b69-a14b-9c5e1b5659c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:39.948244 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e17e13c4-e25c-4b69-a14b-9c5e1b5659c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048215 Aug 24 17:33:39.948820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 498/927] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:33:39 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:40.557165 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f3bc76b1-adae-4af0-8fc8-e8e597c49c06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:40.559449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f3bc76b1-adae-4af0-8fc8-e8e597c49c06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:40.566779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bc76b1-adae-4af0-8fc8-e8e597c49c06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:40.567285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bc76b1-adae-4af0-8fc8-e8e597c49c06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:40.571720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bc76b1-adae-4af0-8fc8-e8e597c49c06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:40.571720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bc76b1-adae-4af0-8fc8-e8e597c49c06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:40.571720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bc76b1-adae-4af0-8fc8-e8e597c49c06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:40.571720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f3bc76b1-adae-4af0-8fc8-e8e597c49c06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:40.600386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f3bc76b1-adae-4af0-8fc8-e8e597c49c06 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048453 Aug 24 17:33:40.602325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 430/928] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 24 17:33:40 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:40.665322 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:40.665820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:40.672887 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:40.673376 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:40.673809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:40.674493 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:40.674968 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:40.675398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:40.702923 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:33:40.961741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-52af686e-54f6-428d-94ae-e0805bfc8b7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:40.964618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-52af686e-54f6-428d-94ae-e0805bfc8b7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:40.971635 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52af686e-54f6-428d-94ae-e0805bfc8b7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:40.972123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52af686e-54f6-428d-94ae-e0805bfc8b7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:40.972563 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52af686e-54f6-428d-94ae-e0805bfc8b7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:40.973263 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52af686e-54f6-428d-94ae-e0805bfc8b7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:40.973714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52af686e-54f6-428d-94ae-e0805bfc8b7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:40.974139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52af686e-54f6-428d-94ae-e0805bfc8b7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:40.983973 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cbc25446-f282-4f94-a471-6afb1651918d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 204 len: 0 microversion: 2.20 time: 0.322202 Aug 24 17:33:40.984695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 499/929] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 24 17:33:40 2022] DELETE /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 17:33:40.994575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:40.995312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:41.001256 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:41.001743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:41.002181 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:41.002868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:41.003341 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:41.003821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:41.004704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-52af686e-54f6-428d-94ae-e0805bfc8b7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046906 Aug 24 17:33:41.005284 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 431/930] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:33:40 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:33:41.075012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:41.075514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:41.082418 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:41.083973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:41.083973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:41.084259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:41.084473 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:41.085096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:41.116402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:33:41.163174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:41.172386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:41.176636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:41.176636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a244ab11-f2d1-48d2-ad5d-46e5126f73c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.184996 Aug 24 17:33:41.176636 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 500/931] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:40 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:33:41.447162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2c9d420e-f272-4bad-bdca-a0fcfc1a26b0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 204 len: 0 microversion: 2.1 time: 0.377112 Aug 24 17:33:41.447754 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 432/932] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:33:41 2022] DELETE /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:33:41.456013 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:41.456659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:41.463519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:41.464006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:41.464446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:41.465132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:41.465584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:41.466005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:41.617725 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:41.626963 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-89a1a9fd-7d39-4604-8d82-6f0ecf0087f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1680 microversion: 2.1 time: 0.174683 Aug 24 17:33:41.627701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 501/933] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:41 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:42.214088 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:42.214798 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:42.221458 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:42.221966 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:42.222828 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:42.223586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:42.224048 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:42.224478 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:42.376273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:42.385460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:42.387005 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:42.388164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7410bb15-023d-4a47-b4d0-bb69e7e0f34e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.178546 Aug 24 17:33:42.388730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 433/934] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:42 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:33:42.648041 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:42.648901 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:42.656238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:42.656717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:42.657156 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:42.657852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:42.658298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:42.658719 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:42.804718 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:42.813447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a59c0d9b-538e-4056-8cf5-6f40743a8003 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1680 microversion: 2.1 time: 0.169291 Aug 24 17:33:42.814030 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 502/935] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:42 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:43.412219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:43.412838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:43.420669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:43.421159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:43.421597 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:43.422287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:43.422287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:43.422287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:43.595535 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:43.610656 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:43.613710 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:43.615065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-616ff2d4-db73-43b0-93d3-f6cbbcf8a2be tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1723 microversion: 2.20 time: 0.206686 Aug 24 17:33:43.615895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 434/936] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:43 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:33:43.836151 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:43.837006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:43.846043 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:43.846541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:43.847016 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:43.847805 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:43.848267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:43.848686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:44.000895 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:44.009984 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6c479440-01aa-4071-9044-91a03636a44c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1680 microversion: 2.1 time: 0.177376 Aug 24 17:33:44.023088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 503/937] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:43 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:44.642087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:44.643259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:44.654009 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:44.654603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:44.655150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:44.656073 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:44.656906 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:44.657626 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:44.775373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:44.788336 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:44.791047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:44.794464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-430e6edf-9b94-479a-ab0b-161f788decc0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1655 microversion: 2.20 time: 0.155071 Aug 24 17:33:44.794464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 435/938] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:44 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:33:45.044832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:45.047392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:45.061669 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:45.062462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:45.063607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:45.064627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:45.065373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:45.066042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:45.102637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-2c7f8039-5fd8-4872-aabb-9bfb0f2ad91b req-722b2c6f-e89d-4ca9-84c4-e998f57ff172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5542f65d-3efd-4dc6-9c28-ea9d8ac19317", "name": "network-vif-deleted", "tag": "afddf061-f22c-4311-aa82-82860263ce79"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:45.116765 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2c7f8039-5fd8-4872-aabb-9bfb0f2ad91b req-722b2c6f-e89d-4ca9-84c4-e998f57ff172 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:45.117693 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2c7f8039-5fd8-4872-aabb-9bfb0f2ad91b req-722b2c6f-e89d-4ca9-84c4-e998f57ff172 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:45.118296 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-2c7f8039-5fd8-4872-aabb-9bfb0f2ad91b req-722b2c6f-e89d-4ca9-84c4-e998f57ff172 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:45.146232 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-2c7f8039-5fd8-4872-aabb-9bfb0f2ad91b req-722b2c6f-e89d-4ca9-84c4-e998f57ff172 service nova] Creating event network-vif-deleted:afddf061-f22c-4311-aa82-82860263ce79 for instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 on hv-cinder-85164 Aug 24 17:33:45.155724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-2c7f8039-5fd8-4872-aabb-9bfb0f2ad91b req-722b2c6f-e89d-4ca9-84c4-e998f57ff172 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055837 Aug 24 17:33:45.157070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 436/939] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:33:45.179510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:45.203824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-864a4900-7b7d-4c55-aeb4-e459f6d2519d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1612 microversion: 2.1 time: 0.168811 Aug 24 17:33:45.219418 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 504/940] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:45 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1612 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:45.332923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-bc0cf417-3d1d-42a3-b12e-ce37e3eab3ae req-cc455f39-0dfe-47f5-9cd8-249961484839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b97103-4f8f-4e11-aadd-a589dac7490e", "name": "network-vif-deleted", "tag": "50697787-0e63-4fda-826f-14d5ab0209ee"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:45.358147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bc0cf417-3d1d-42a3-b12e-ce37e3eab3ae req-cc455f39-0dfe-47f5-9cd8-249961484839 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:45.358630 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bc0cf417-3d1d-42a3-b12e-ce37e3eab3ae req-cc455f39-0dfe-47f5-9cd8-249961484839 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:45.359115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-bc0cf417-3d1d-42a3-b12e-ce37e3eab3ae req-cc455f39-0dfe-47f5-9cd8-249961484839 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:45.375553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-bc0cf417-3d1d-42a3-b12e-ce37e3eab3ae req-cc455f39-0dfe-47f5-9cd8-249961484839 service nova] Creating event network-vif-deleted:50697787-0e63-4fda-826f-14d5ab0209ee for instance 95b97103-4f8f-4e11-aadd-a589dac7490e on hv-cinder-85164 Aug 24 17:33:45.386494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-bc0cf417-3d1d-42a3-b12e-ce37e3eab3ae req-cc455f39-0dfe-47f5-9cd8-249961484839 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058520 Aug 24 17:33:45.387642 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 437/941] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:45.829392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:45.829392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:45.835695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:45.836302 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:45.836853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:45.839311 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:45.840303 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:45.841229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:45.891956 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:45.892520 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:45.893021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:45.893558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lazy-loading 'fault' on Instance uuid 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:33:45.938112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:45.947913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:45.950698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:45.952524 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0c684a68-e868-4372-b4b4-2d631c33207b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 200 len: 1369 microversion: 2.20 time: 0.135311 Aug 24 17:33:45.954025 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 505/942] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:45 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 1369 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:33:46.229359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:46.230066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:46.237478 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:46.237975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:46.242677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:46.242677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:46.242677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:46.242677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:46.298814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:46.299341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:46.299970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:46.300602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lazy-loading 'fault' on Instance uuid 95b97103-4f8f-4e11-aadd-a589dac7490e {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:33:46.375526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:46.386927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fdcbfd0b-6d19-4312-b205-78c86e4e84f1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 200 len: 1331 microversion: 2.1 time: 0.162556 Aug 24 17:33:46.388234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 438/943] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:46 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 1331 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:46.999811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:47.000372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:47.007908 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:47.010388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:47.010388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:47.010388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:47.010388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:47.013637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:47.019398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:33:47.030327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] HTTP exception thrown: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Request method failure captured: Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 HTTP/1.1 Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8r0X6gglO-ZMlPwgkPYH9ImTSOa9mR-FRUbOaZ__3JqJ-iq3smlaDm9SC_IckWkebKWzvU2D8WwtSGf-PsIUnXR8ic9MZWul36ejPPnFI5cTDjy3TV00QF-FcDG1DeWEEr8Q3R0tVT_Ju7DCD0FmYrA9FnoP3uxX6VQ3BIIlqwnRw Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:33:47.032419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15cff6e1349f4bb1a2905e6e5231fc2d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: c379c845fccd43c08e8699976d506801 Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:33:47.035664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '5542f65d-3efd-4dc6-9c28-ea9d8ac19317'} Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:33:47.037403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:33:47.040983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.043423 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Returning 404 to user: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:33:47.043423 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2ed28811-3517-4385-b07e-5487024f3a93 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 404 len: 111 microversion: 2.20 time: 0.043044 Aug 24 17:33:47.043423 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 506/944] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:46 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:33:47.048095 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5399ca6e-390c-4a49-8b96-3706285e9b94 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '.version_select at 0x7f3f23e07e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:47.163170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5399ca6e-390c-4a49-8b96-3706285e9b94 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-711717835" status: 204 len: 0 microversion: 2.20 time: 0.119315 Aug 24 17:33:47.164372 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 439/945] 10.222.0.18 () {60 vars in 1259 bytes} [Wed Aug 24 17:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-711717835 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:33:47.411217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:47.411924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:47.419128 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:47.419628 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:47.420071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:47.420860 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:47.421330 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:47.421757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:47.446602 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e HTTP/1.1 Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:33:47.449893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:33:47.453153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '95b97103-4f8f-4e11-aadd-a589dac7490e'} Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:33:47.453958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:33:47.457089 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:33:47.460079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:33:47.460079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-75d95da6-f97e-4703-8202-186dd645909a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 404 len: 111 microversion: 2.1 time: 0.045515 Aug 24 17:33:47.460079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 507/946] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:47 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:33:47.464150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de07d543-eb31-4755-82f1-55ae748d88c1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '.version_select at 0x7f3f23e75430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:47.566340 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de07d543-eb31-4755-82f1-55ae748d88c1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165274637" status: 202 len: 0 microversion: 2.1 time: 0.107249 Aug 24 17:33:47.566970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 440/947] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 24 17:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165274637 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:33:48.609234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-416ac51f-5974-4a7d-9df6-a9dbae5604bd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'create', calling method: .version_select at 0x7f3f34631430>, body: {"keypair": {"name": "tempest-keypair-427059925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkTGiaIGYAKYMQQGce1gzpk2iRR0wE8Dum0RlOGCOtBTnmJxfeE3JElHpzI2DzLPymjuXnmTa0Lm3SpnFr5xFYIvjSm9G8Cf5r0W5mNkF/WfUl4V0UUiF3zs9NhXByj7g=="}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:48.627524 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-416ac51f-5974-4a7d-9df6-a9dbae5604bd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Getting quotas for project 15cff6e1349f4bb1a2905e6e5231fc2d. Resources: {'key_pairs'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:33:48.635049 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-416ac51f-5974-4a7d-9df6-a9dbae5604bd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Getting quotas for user c379c845fccd43c08e8699976d506801 and project 15cff6e1349f4bb1a2905e6e5231fc2d. Resources: {'key_pairs'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:33:48.675992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c7ee99a8-ccd0-40d7-83f0-90cb300e324d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: .version_select at 0x7f3f23e521f0>, body: {"keypair": {"name": "tempest-keypair-198961703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjO5wYgVrd2ZNgd31gvT5f93HapMqfeMrDDmyeaECELquogy7y/VF8Jewn10w1l7Y6mvGw7ySWTU8rQ6BFC4U9fRxJe08dhLgFE/0drj5IWPzOtJyIz6ksr0GPjIw4PEw=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:48.692635 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-c7ee99a8-ccd0-40d7-83f0-90cb300e324d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:33:48.697345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-c7ee99a8-ccd0-40d7-83f0-90cb300e324d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for user 160ce86c89ea449da346d98d20ce2a9e and project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:33:48.751409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-416ac51f-5974-4a7d-9df6-a9dbae5604bd tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.146450 Aug 24 17:33:48.752104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 508/948] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Aug 24 17:33:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 17:33:48.779960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c7ee99a8-ccd0-40d7-83f0-90cb300e324d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108353 Aug 24 17:33:48.780502 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 441/949] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:33:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:33:52.076161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1550357904", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f36e29c-a00d-4dea-8a63-ed5b84921e41"}], "security_groups": [{"name": "tempest-securitygroup--1935813029"}], "key_name": "tempest-keypair-427059925", "user_data": "}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:52.210895 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] validate_networks() for [('0f36e29c-a00d-4dea-8a63-ed5b84921e41', None, None, None, None, None)] {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:33:52.384237 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-157807410", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9785c9b4-9808-422c-887b-d51293243d04"}], "security_groups": [{"name": "tempest-securitygroup--1644916788"}], "key_name": "tempest-keypair-198961703", "user_data": "}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:52.574306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] validate_networks() for [('9785c9b4-9808-422c-887b-d51293243d04', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:33:52.802675 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:33:52.803447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:33:52.804275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:33:52.804971 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:33:52.805845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:33:52.820546 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:52.821958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:52.822646 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:52.823884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:52.824510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:52.824980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:52.845462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Getting quotas for project 15cff6e1349f4bb1a2905e6e5231fc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:33:52.850530 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Getting quotas for user c379c845fccd43c08e8699976d506801 and project 15cff6e1349f4bb1a2905e6e5231fc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:33:52.863426 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:33:52.867717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:33:53.098781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ea7f386f-34de-4f99-935a-e9a9d5239584 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.022427 Aug 24 17:33:53.099431 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:33:53.099554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 509/950] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Aug 24 17:33:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 17:33:53.099653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:33:53.099653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:33:53.099653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:33:53.099653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:33:53.105029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:53.105660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:53.105785 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-851a3a92-40ad-4bed-9fab-03ca394addc5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:53.106092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:53.106312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-851a3a92-40ad-4bed-9fab-03ca394addc5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:53.106812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:53.107496 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:53.107956 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:53.141437 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:33:53.145099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for user 160ce86c89ea449da346d98d20ce2a9e and project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:33:53.158214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:33:53.160708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:33:53.164878 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-851a3a92-40ad-4bed-9fab-03ca394addc5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:53.173248 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-851a3a92-40ad-4bed-9fab-03ca394addc5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:53.175008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-851a3a92-40ad-4bed-9fab-03ca394addc5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:53.176405 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-851a3a92-40ad-4bed-9fab-03ca394addc5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1281 microversion: 2.20 time: 0.075077 Aug 24 17:33:53.176977 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 510/951] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:53 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:33:53.355835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-856084b9-bf64-40cd-b5a5-82da7ac1daff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.977505 Aug 24 17:33:53.356341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 442/952] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:33:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:33:53.368033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-50d99c2b-6148-4d5a-9a19-3ca5ec63a2cf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:53.369299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-50d99c2b-6148-4d5a-9a19-3ca5ec63a2cf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:53.427583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-50d99c2b-6148-4d5a-9a19-3ca5ec63a2cf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:53.437692 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-50d99c2b-6148-4d5a-9a19-3ca5ec63a2cf tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1240 microversion: 2.1 time: 0.073546 Aug 24 17:33:53.438616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 511/953] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:53 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:54.200183 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:54.200828 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:54.207408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:54.207408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:54.207408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:54.213534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:54.213534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:54.213534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:54.286465 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:54.295569 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:54.297077 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:54.298174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eaa95016-00f8-4889-9a36-e68edbb039ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1285 microversion: 2.20 time: 0.102594 Aug 24 17:33:54.298744 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 443/954] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:54 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:33:54.459229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:54.459831 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:54.467639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:54.468131 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:54.468572 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:54.469270 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:54.469722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:54.470145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:54.542165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:54.556321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-32f1e392-c1b0-472a-a404-2e57747c059a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1244 microversion: 2.1 time: 0.096003 Aug 24 17:33:54.556321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 512/955] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:54 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:55.326307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:55.326986 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:55.334248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:55.334736 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:55.335213 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:55.335926 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:55.336383 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:55.336803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:55.409082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:55.418795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:55.420349 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:55.421530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5891f6de-3a45-40d5-8044-0f94ad98658e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1333 microversion: 2.20 time: 0.101182 Aug 24 17:33:55.422144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 444/956] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:55 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:33:55.579219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:55.579808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:55.586824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:55.588214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:55.588382 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:55.588985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:55.591430 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:55.591856 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:55.674368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:55.685463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4a445a8a-5761-413c-b030-e152f4efc33c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1292 microversion: 2.1 time: 0.110590 Aug 24 17:33:55.686059 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 513/957] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:55 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1292 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:56.457164 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:56.462928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:56.468003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:56.468583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:56.469019 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:56.469742 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:56.470198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:56.470617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:56.605955 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:56.616624 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:56.630632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:56.630632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-12fec04f-1bf2-429b-a0dc-e3192e0b3f37 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1351 microversion: 2.20 time: 0.170620 Aug 24 17:33:56.630632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 445/958] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:56 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:33:56.714280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:56.714916 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:56.723152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:56.723661 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:56.724147 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:56.724857 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:56.725338 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:56.725758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:56.829267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:56.842420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b2d42586-5681-430c-a544-9b2805129ca7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1310 microversion: 2.1 time: 0.132453 Aug 24 17:33:56.843289 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 514/959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:56 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:33:57.652618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:57.662615 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:57.662615 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:57.662615 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:57.662615 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:57.665296 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:57.666076 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:57.666733 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:57.866247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:57.867232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:57.874061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:57.874557 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:57.875038 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:57.875737 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:57.876196 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:57.876622 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:57.934588 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:57.946260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:57.948733 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:57.949971 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dcdececc-ddb6-43d9-823f-5d112baa16d5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.304044 Aug 24 17:33:57.951740 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 446/960] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:57 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:33:58.125671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:58.135221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2de61dd0-1333-4473-bcf3-cc7d10b0acbe tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.273140 Aug 24 17:33:58.135809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 515/961] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:57 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:33:58.503791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d44030e2-7c40-4ef7-9d5a-edf02c3e1a99 req-4257aef7-f03a-4471-84e2-3b2b018a0759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127fd694-1843-4ba5-97aa-2565c01c30c2", "tag": "dc1417c8-efa2-4bc9-882a-0f8de0684957"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:58.518529 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d44030e2-7c40-4ef7-9d5a-edf02c3e1a99 req-4257aef7-f03a-4471-84e2-3b2b018a0759 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:58.519517 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d44030e2-7c40-4ef7-9d5a-edf02c3e1a99 req-4257aef7-f03a-4471-84e2-3b2b018a0759 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:58.520322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d44030e2-7c40-4ef7-9d5a-edf02c3e1a99 req-4257aef7-f03a-4471-84e2-3b2b018a0759 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:58.533792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d44030e2-7c40-4ef7-9d5a-edf02c3e1a99 req-4257aef7-f03a-4471-84e2-3b2b018a0759 service nova] Creating event network-changed:dc1417c8-efa2-4bc9-882a-0f8de0684957 for instance 127fd694-1843-4ba5-97aa-2565c01c30c2 on hv-cinder-85164 Aug 24 17:33:58.547943 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d44030e2-7c40-4ef7-9d5a-edf02c3e1a99 req-4257aef7-f03a-4471-84e2-3b2b018a0759 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042301 Aug 24 17:33:58.547943 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 447/962] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:58.744278 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-2862a01f-85b8-4ce0-8407-c081e8fab361 req-bb1816e5-ee4d-4a14-9044-29a7b545ec6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f9ac6a-3c93-4196-826d-9e1f7adb52bf", "tag": "f505ca09-8aa8-4a23-9e76-9bf9392fdff8"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:33:58.756229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-2862a01f-85b8-4ce0-8407-c081e8fab361 req-bb1816e5-ee4d-4a14-9044-29a7b545ec6d service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:58.757182 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-2862a01f-85b8-4ce0-8407-c081e8fab361 req-bb1816e5-ee4d-4a14-9044-29a7b545ec6d service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:58.757751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-2862a01f-85b8-4ce0-8407-c081e8fab361 req-bb1816e5-ee4d-4a14-9044-29a7b545ec6d service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:58.769893 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-2862a01f-85b8-4ce0-8407-c081e8fab361 req-bb1816e5-ee4d-4a14-9044-29a7b545ec6d service nova] Creating event network-changed:f505ca09-8aa8-4a23-9e76-9bf9392fdff8 for instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf on hv-cinder-85164 Aug 24 17:33:58.775824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-2862a01f-85b8-4ce0-8407-c081e8fab361 req-bb1816e5-ee4d-4a14-9044-29a7b545ec6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036369 Aug 24 17:33:58.777148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 516/963] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:33:58.976517 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:58.978509 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:58.987117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:58.988355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:58.991366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:58.992238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:58.992726 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:58.993188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:59.165878 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:33:59.167356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:33:59.180271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:59.180808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:59.181253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:59.181960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:33:59.182418 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:33:59.182843 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:33:59.203593 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:59.217366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:59.220138 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:59.222215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b7206b74-7cb9-47ef-8ad0-4391fcfc5fa1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.251126 Aug 24 17:33:59.223266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 448/964] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:33:58 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:33:59.335941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:33:59.347866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-19df724b-d2fd-4508-a5b9-cb38a6ccdddd tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.193130 Aug 24 17:33:59.348557 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 517/965] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:33:59 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:00.246863 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:00.247652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:00.254760 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:00.255393 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:00.255884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:00.256807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:00.257437 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:00.257882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:00.278453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:00.373315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:00.374236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:00.381479 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:00.382060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:00.382744 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:00.385278 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:00.385953 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:00.386576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:00.538369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:00.557429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:00.560559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:00.561975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7fe39d8c-2857-4678-83e0-d193aa6922ba tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.320116 Aug 24 17:34:00.562804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 449/966] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:00 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:00.901995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:00.909815 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f9ae8ae4-58c2-4f57-87b4-d535ac33ae7d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.541584 Aug 24 17:34:00.910399 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 518/967] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:00 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:01.585896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:01.586579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:01.593814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:01.594305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:01.594757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:01.595490 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:01.595950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:01.596378 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:01.746933 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:01.758387 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:01.759983 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:01.761162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f696819-9cba-4d9e-853e-0ba3075f200c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.179289 Aug 24 17:34:01.761720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 450/968] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:01 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:01.931929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:01.932611 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:01.939935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:01.939935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:01.940224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:01.942496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:01.942496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:01.942496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:02.095157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:02.109380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d58f46c8-4fad-45a6-8810-e0131be5e6dc tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.181817 Aug 24 17:34:02.110161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 519/969] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:01 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:02.787433 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:02.788460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:02.798448 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:02.799065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:02.799445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:02.800157 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:02.800614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:02.801041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:02.939220 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:02.948606 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:02.950197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:02.951383 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d66d210e-2132-4e20-8286-b548e3b67d81 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.170788 Aug 24 17:34:02.951958 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 451/970] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:02 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:03.129495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:03.130206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:03.132218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:03.138310 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:03.138816 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:03.139260 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:03.139955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:03.140404 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:03.140826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:03.279936 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:03.288070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-81b29bc5-3db8-42a0-9946-5bec501d7835 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.162426 Aug 24 17:34:03.288639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 520/971] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:03 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:03.974541 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:03.975212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:03.977104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:03.978312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=10 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:03.983778 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:03.984270 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:03.984714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:03.985416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:03.985877 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:03.986309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:04.126581 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:04.135125 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:04.136693 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:04.137819 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-302a7b45-9bfc-408d-a9c3-9781a824acd8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.167284 Aug 24 17:34:04.138395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 452/972] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:03 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:04.309761 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:04.310420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:04.312432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=14 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:04.317783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:04.319409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:04.319409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:04.319623 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:04.319896 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:04.320316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:04.456005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:04.466983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3ae9210a-8e8d-4e94-b7ba-499f87c48857 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.161271 Aug 24 17:34:04.467976 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 521/973] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:04 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:05.160810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:05.161340 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:05.167993 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:05.168511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:05.168949 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:05.169774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:05.170971 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:05.171426 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:05.309120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:05.317421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:05.318951 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:05.320070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b434f9dd-16bd-41c3-8506-9678f930beda tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.163328 Aug 24 17:34:05.320631 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 453/974] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:05 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:05.494783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:05.495362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:05.502189 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:05.502668 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:05.503134 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:05.503826 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:05.504280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:05.504699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:05.653476 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:05.667834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-7fe29cd8-f1b1-4f56-839d-a293a88052ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.177644 Aug 24 17:34:05.669160 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 522/975] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:05 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:06.343534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:06.344434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:06.353981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:06.354497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:06.354949 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:06.355850 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:06.356419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:06.357009 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:06.522060 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:06.531890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:06.533399 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:06.534536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2a1c485-ee39-4c48-87cc-5f3a3f2edfc8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.195452 Aug 24 17:34:06.535147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 454/976] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:06 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:34:06.689368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:06.690023 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:06.696736 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:06.697228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:06.697654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:06.698345 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:06.698796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:06.699769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:06.839263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:06.847762 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-460775cf-a1b6-43e2-830f-6d791f150181 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.162303 Aug 24 17:34:06.848349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 523/977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:06 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:07.558344 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:07.559139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:07.567224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:07.567723 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:07.568169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:07.568875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:07.569334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:07.569766 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:07.713232 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:07.721813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:07.723342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:07.724469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-633a3f7f-c1ad-461b-a858-80aaab75e73c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.170635 Aug 24 17:34:07.725041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 455/978] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:07 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:07.870918 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:07.871508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:07.878101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:07.878589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:07.879056 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:07.879752 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:07.880202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:07.880622 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:08.017032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:08.025733 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-624c3cd2-def8-4ff9-afae-bc74554cf839 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.158761 Aug 24 17:34:08.026344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 524/979] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:07 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:08.459684 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-11f623a2-f05d-40cf-8fd5-2c321bb1f3c4 req-deccd070-4663-4fdf-83af-7a4698794e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127fd694-1843-4ba5-97aa-2565c01c30c2", "name": "network-vif-plugged", "status": "completed", "tag": "dc1417c8-efa2-4bc9-882a-0f8de0684957"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:08.469652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-11f623a2-f05d-40cf-8fd5-2c321bb1f3c4 req-deccd070-4663-4fdf-83af-7a4698794e31 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:08.470118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-11f623a2-f05d-40cf-8fd5-2c321bb1f3c4 req-deccd070-4663-4fdf-83af-7a4698794e31 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:08.470551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-11f623a2-f05d-40cf-8fd5-2c321bb1f3c4 req-deccd070-4663-4fdf-83af-7a4698794e31 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:08.484128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-11f623a2-f05d-40cf-8fd5-2c321bb1f3c4 req-deccd070-4663-4fdf-83af-7a4698794e31 service nova] Creating event network-vif-plugged:dc1417c8-efa2-4bc9-882a-0f8de0684957 for instance 127fd694-1843-4ba5-97aa-2565c01c30c2 on hv-cinder-85164 Aug 24 17:34:08.489711 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-11f623a2-f05d-40cf-8fd5-2c321bb1f3c4 req-deccd070-4663-4fdf-83af-7a4698794e31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 Aug 24 17:34:08.490769 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 456/980] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:08.749581 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:08.750102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:08.756560 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:08.757104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:08.757533 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:08.758249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:08.759660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:08.759660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:08.944022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:08.952694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:08.954220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:08.955402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-010206b3-44d1-47b8-8cbe-819939a8911c tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.210793 Aug 24 17:34:08.955998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 525/981] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:08 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:34:09.052849 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:09.052849 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:09.063432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:09.064208 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:09.064922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:09.066083 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:09.066798 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:09.067390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:09.229318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:09.239468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-495dc401-2b91-4dc7-b4bd-c480ecab522a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.195090 Aug 24 17:34:09.240067 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 457/982] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:09 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:09.979938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:09.980621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:09.982997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:09.987803 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:09.988360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:09.989136 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:09.990065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:09.990553 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:09.991864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:10.146427 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:10.157818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:10.159649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:10.160774 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-854b02a3-355c-4a0e-80c9-231765c6e18f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.185358 Aug 24 17:34:10.161327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 526/983] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:09 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:34:10.261708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:10.262360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:10.264804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:10.269594 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:10.270079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:10.270514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:10.271274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:10.271724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:10.277974 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:10.420678 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:10.430135 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e233f456-25e8-45d6-a7a0-88937642fa44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.172502 Aug 24 17:34:10.431323 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 458/984] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:10 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:10.911806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-66bd200c-b178-4eba-a8fe-dd9e3f4632b6 req-2a32ecd5-f534-4af0-933d-4b94eb4e987b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f9ac6a-3c93-4196-826d-9e1f7adb52bf", "name": "network-vif-plugged", "status": "completed", "tag": "f505ca09-8aa8-4a23-9e76-9bf9392fdff8"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:10.928231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-66bd200c-b178-4eba-a8fe-dd9e3f4632b6 req-2a32ecd5-f534-4af0-933d-4b94eb4e987b service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:10.928705 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-66bd200c-b178-4eba-a8fe-dd9e3f4632b6 req-2a32ecd5-f534-4af0-933d-4b94eb4e987b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:10.929134 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-66bd200c-b178-4eba-a8fe-dd9e3f4632b6 req-2a32ecd5-f534-4af0-933d-4b94eb4e987b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:10.942738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-66bd200c-b178-4eba-a8fe-dd9e3f4632b6 req-2a32ecd5-f534-4af0-933d-4b94eb4e987b service nova] Creating event network-vif-plugged:f505ca09-8aa8-4a23-9e76-9bf9392fdff8 for instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf on hv-cinder-85164 Aug 24 17:34:10.947802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-66bd200c-b178-4eba-a8fe-dd9e3f4632b6 req-2a32ecd5-f534-4af0-933d-4b94eb4e987b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040386 Aug 24 17:34:10.950092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 527/985] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:11.184832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:11.185385 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:11.192064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:11.192550 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:11.192998 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:11.193683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:11.194138 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:11.194627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:11.338121 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:11.346677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:11.348428 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:11.349560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2086e047-f567-4bd8-a007-fbcf8c1cc415 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1407 microversion: 2.20 time: 0.169310 Aug 24 17:34:11.350295 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 459/986] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:11 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:11.452778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:11.453503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:11.459868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:11.460378 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:11.460868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:11.461562 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:11.462011 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:11.462486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:11.613708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:11.628479 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f7a910ea-c09e-48dd-874d-76dc024d5f4e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.180243 Aug 24 17:34:11.629523 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 528/987] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:11 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:12.372740 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:12.373371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:12.379816 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:12.380310 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:12.380790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:12.381468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:12.381914 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:12.382333 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:12.545097 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:12.554525 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:12.556359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:12.557623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4448a662-c084-44d6-8bcf-eadb4c9fe44a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1599 microversion: 2.20 time: 0.188802 Aug 24 17:34:12.558198 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 460/988] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:34:12 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1599 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:34:12.580832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-34b7a472-b24b-47eb-871a-bdc539063b0b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:12.581436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-34b7a472-b24b-47eb-871a-bdc539063b0b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:12.588679 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34b7a472-b24b-47eb-871a-bdc539063b0b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:12.589169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34b7a472-b24b-47eb-871a-bdc539063b0b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:12.589610 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34b7a472-b24b-47eb-871a-bdc539063b0b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:12.590302 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34b7a472-b24b-47eb-871a-bdc539063b0b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:12.590758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34b7a472-b24b-47eb-871a-bdc539063b0b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:12.591209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34b7a472-b24b-47eb-871a-bdc539063b0b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:12.593935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:12.650815 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:12.651462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:12.661103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:12.661794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:12.662239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:12.662966 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:12.663421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:12.663848 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:12.682026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-34b7a472-b24b-47eb-871a-bdc539063b0b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105164 Aug 24 17:34:12.682587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 529/989] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Aug 24 17:34:12 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:34:12.822480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:12.831398 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b9ca98dd-32bf-4cc5-9463-d4ce6214373e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.185281 Aug 24 17:34:12.832671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 461/990] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:12 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:34:13.853349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:13.853970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:13.860356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:13.860867 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:13.861326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:13.862139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:13.862620 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:13.863085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:14.014258 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-07f8dd24-c1a6-4bfb-b65f-72ad468670d9 req-a5b1eb18-07e6-4cda-82d3-cd4b9050064c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127fd694-1843-4ba5-97aa-2565c01c30c2", "tag": "dc1417c8-efa2-4bc9-882a-0f8de0684957"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:14.026620 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-07f8dd24-c1a6-4bfb-b65f-72ad468670d9 req-a5b1eb18-07e6-4cda-82d3-cd4b9050064c service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:14.032696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-07f8dd24-c1a6-4bfb-b65f-72ad468670d9 req-a5b1eb18-07e6-4cda-82d3-cd4b9050064c service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:14.032696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-07f8dd24-c1a6-4bfb-b65f-72ad468670d9 req-a5b1eb18-07e6-4cda-82d3-cd4b9050064c service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:14.042825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-07f8dd24-c1a6-4bfb-b65f-72ad468670d9 req-a5b1eb18-07e6-4cda-82d3-cd4b9050064c service nova] Creating event network-changed:dc1417c8-efa2-4bc9-882a-0f8de0684957 for instance 127fd694-1843-4ba5-97aa-2565c01c30c2 on hv-cinder-85164 Aug 24 17:34:14.048964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-07f8dd24-c1a6-4bfb-b65f-72ad468670d9 req-a5b1eb18-07e6-4cda-82d3-cd4b9050064c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038717 Aug 24 17:34:14.050031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 462/991] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:34:14.289770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:14.300286 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-30319fc4-7edb-4679-9a44-00611713ffe8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1366 microversion: 2.1 time: 0.451643 Aug 24 17:34:14.300976 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 530/992] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:13 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:15.339157 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:15.344079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:15.347250 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:15.347758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:15.348186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:15.349223 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:15.349574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:15.349997 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:15.542817 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:15.551380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-86773856-f5f0-46dd-87f8-46e6c644bb9c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1554 microversion: 2.1 time: 0.219231 Aug 24 17:34:15.552654 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 463/993] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:15 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:15.573934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fe8d8e65-cb7d-4ef1-b067-ccdc4fa30946 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:15.574548 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fe8d8e65-cb7d-4ef1-b067-ccdc4fa30946 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:15.581489 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe8d8e65-cb7d-4ef1-b067-ccdc4fa30946 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:15.581860 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe8d8e65-cb7d-4ef1-b067-ccdc4fa30946 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:15.582301 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe8d8e65-cb7d-4ef1-b067-ccdc4fa30946 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:15.583032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe8d8e65-cb7d-4ef1-b067-ccdc4fa30946 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:15.583496 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe8d8e65-cb7d-4ef1-b067-ccdc4fa30946 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:15.583942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe8d8e65-cb7d-4ef1-b067-ccdc4fa30946 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:15.671846 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fe8d8e65-cb7d-4ef1-b067-ccdc4fa30946 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102445 Aug 24 17:34:15.672446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 531/994] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 24 17:34:15 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:34:16.826308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-656bf079-2230-4ab1-9c82-cd73b3be46ab req-c4f1d76e-f902-430e-b10b-ffdcbcf38d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f9ac6a-3c93-4196-826d-9e1f7adb52bf", "tag": "f505ca09-8aa8-4a23-9e76-9bf9392fdff8"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:16.843616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-656bf079-2230-4ab1-9c82-cd73b3be46ab req-c4f1d76e-f902-430e-b10b-ffdcbcf38d01 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:16.844411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-656bf079-2230-4ab1-9c82-cd73b3be46ab req-c4f1d76e-f902-430e-b10b-ffdcbcf38d01 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:16.845127 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-656bf079-2230-4ab1-9c82-cd73b3be46ab req-c4f1d76e-f902-430e-b10b-ffdcbcf38d01 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:16.865264 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-656bf079-2230-4ab1-9c82-cd73b3be46ab req-c4f1d76e-f902-430e-b10b-ffdcbcf38d01 service nova] Creating event network-changed:f505ca09-8aa8-4a23-9e76-9bf9392fdff8 for instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf on hv-cinder-85164 Aug 24 17:34:16.874403 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-656bf079-2230-4ab1-9c82-cd73b3be46ab req-c4f1d76e-f902-430e-b10b-ffdcbcf38d01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055235 Aug 24 17:34:16.875557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 464/995] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:19.269200 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c4598786-a3c5-4651-aa4f-093c9f0cab70 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:19.271379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c4598786-a3c5-4651-aa4f-093c9f0cab70 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:19.278606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4598786-a3c5-4651-aa4f-093c9f0cab70 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:19.279263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4598786-a3c5-4651-aa4f-093c9f0cab70 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:19.279801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4598786-a3c5-4651-aa4f-093c9f0cab70 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:19.280961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4598786-a3c5-4651-aa4f-093c9f0cab70 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:19.281672 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4598786-a3c5-4651-aa4f-093c9f0cab70 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:19.282315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4598786-a3c5-4651-aa4f-093c9f0cab70 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:19.314032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c4598786-a3c5-4651-aa4f-093c9f0cab70 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049268 Aug 24 17:34:19.314497 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 532/996] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:34:19 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:34:19.378693 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:19.379316 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:19.386324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:19.386975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:19.392689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:19.392689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:19.392689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:19.392689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:19.417552 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:34:19.741654 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cfa63e7f-da73-4c4d-804e-0a2a8a8deb8e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "DELETE /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 204 len: 0 microversion: 2.1 time: 0.367455 Aug 24 17:34:19.742273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 465/997] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:34:19 2022] DELETE /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:34:19.751284 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:19.752112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:19.760145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:19.760145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:19.760145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:19.760588 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:19.760792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:19.761210 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:19.932643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:19.941035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f534449a-d403-4992-b3e1-5f0c4c4add3b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1674 microversion: 2.1 time: 0.193624 Aug 24 17:34:19.942528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 533/998] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:19 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:20.963661 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:20.964779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:20.973134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:20.973618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:20.974055 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:20.974775 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:20.975240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:20.975654 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:20.999012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:21.147496 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:21.156753 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-009f28c1-8365-48c0-9da6-fbc0401db27e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1674 microversion: 2.1 time: 0.198500 Aug 24 17:34:21.157353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 466/999] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:20 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:22.187642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:22.188261 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:22.194442 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:22.195092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:22.195644 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:22.196941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:22.197346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:22.197775 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:22.292770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:22.304325 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-743a07d9-81fb-402f-8795-9c6fef41bd72 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1606 microversion: 2.1 time: 0.120589 Aug 24 17:34:22.304822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 534/1000] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:22 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1606 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:22.388338 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-390621ad-a17b-4be4-ad55-eff4df9e0137 req-d289b905-dca0-4a12-aef3-2c28db99966f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483b254a-2178-420a-8a82-111e13dfaa7e", "name": "network-vif-deleted", "tag": "55059be5-28aa-4c2b-8f3b-8e394679665a"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:22.404423 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-390621ad-a17b-4be4-ad55-eff4df9e0137 req-d289b905-dca0-4a12-aef3-2c28db99966f service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:22.413290 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-390621ad-a17b-4be4-ad55-eff4df9e0137 req-d289b905-dca0-4a12-aef3-2c28db99966f service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:22.413290 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-390621ad-a17b-4be4-ad55-eff4df9e0137 req-d289b905-dca0-4a12-aef3-2c28db99966f service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:22.421332 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-390621ad-a17b-4be4-ad55-eff4df9e0137 req-d289b905-dca0-4a12-aef3-2c28db99966f service nova] Creating event network-vif-deleted:55059be5-28aa-4c2b-8f3b-8e394679665a for instance 483b254a-2178-420a-8a82-111e13dfaa7e on hv-cinder-85164 Aug 24 17:34:22.426965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-390621ad-a17b-4be4-ad55-eff4df9e0137 req-d289b905-dca0-4a12-aef3-2c28db99966f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043240 Aug 24 17:34:22.439301 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 467/1001] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:23.327483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:23.328193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:23.335407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:23.336015 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:23.336468 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:23.337738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:23.338198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:23.338629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:23.380294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:23.380793 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:23.381362 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:23.381825 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lazy-loading 'fault' on Instance uuid 483b254a-2178-420a-8a82-111e13dfaa7e {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:34:23.429372 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:23.438283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9d4bad70-cf2a-491a-8263-9905d7f4872d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 200 len: 1328 microversion: 2.1 time: 0.114692 Aug 24 17:34:23.438851 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 535/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:23 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:24.461368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:24.462014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:24.468837 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:24.469320 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:24.469756 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:24.470462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:24.470928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:24.471374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:24.484602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] HTTP exception thrown: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Request method failure captured: Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e HTTP/1.1 Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8j5zFz2233Z-4Le0ICLal1aeDW83aa8-mIeD_Dc2LE7PtEXQ_qqyYyzscxZJ400Qqj9wo_PtZvdx7EmhuGIQNQjU_w1MwbDicd7tQs0FOlTrxS0d02cYATOQ4pSUSp7lbU9s6ErDhmWRqi1tqW5JKHTKAlexwBmcLhduopfQJrkuU Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:34:24.486259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6c8612c530e1495f8d6f4927560a9012", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: ef9e96b709b345c08a4ea10f14211668 Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:34:24.487779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '483b254a-2178-420a-8a82-111e13dfaa7e'} Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:24.488662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:34:24.490056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:24.491489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Returning 404 to user: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:24.491489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-768c4b0f-cc1f-45cb-9f33-49bb7832e15e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 404 len: 111 microversion: 2.1 time: 0.031180 Aug 24 17:34:24.491489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 468/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:24 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:34:24.496821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ac536649-7ea2-435d-b889-3c600adf6cb9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '.version_select at 0x7f3f309e6040>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:24.600625 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ac536649-7ea2-435d-b889-3c600adf6cb9 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262032300" status: 202 len: 0 microversion: 2.1 time: 0.107565 Aug 24 17:34:24.601206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 536/1004] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 24 17:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262032300 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:34:25.418183 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f7106092-e409-4565-8cd8-2687164ab982 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'create', calling method: .version_select at 0x7f3f34598b80>, body: {"keypair": {"name": "tempest-keypair-441586037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgbat1aDuWdjy6z+DMlrOhXS/og5E3PZWeW3s1J5bbNiL+Vg8gVLBfu2ijjEZykbR2bxfN46BvY1E8kKsVcAwK3EpkHf3aON1kQIzvRC4N1h8/mVzB1K4i5k34cT9QJug=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:25.433397 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-f7106092-e409-4565-8cd8-2687164ab982 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Getting quotas for project 6c8612c530e1495f8d6f4927560a9012. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:34:25.437246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-f7106092-e409-4565-8cd8-2687164ab982 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Getting quotas for user ef9e96b709b345c08a4ea10f14211668 and project 6c8612c530e1495f8d6f4927560a9012. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:34:25.550226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f7106092-e409-4565-8cd8-2687164ab982 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137776 Aug 24 17:34:25.551241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 469/1005] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:34:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:27.518876 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:27.526069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:27.546578 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:27.547510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:27.548478 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:27.548922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:27.549065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:27.549504 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:27.651051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lazy-loading 'services' on Instance uuid d7feb685-67d6-4b7e-be2b-3e07e65391fb {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:34:27.852203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3cf4ae4a-ff67-48b3-a8fc-f3dcf9db3625 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments/8fe611b6-cb8b-441a-a2ef-22911e0a991a" status: 202 len: 0 microversion: 2.1 time: 0.357924 Aug 24 17:34:27.853446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 537/1006] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:34:27 2022] DELETE /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments/8fe611b6-cb8b-441a-a2ef-22911e0a991a => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:34:27.864652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0966e574-d705-41f1-ac71-c1d2f114b45c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:27.867036 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0966e574-d705-41f1-ac71-c1d2f114b45c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:27.875057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0966e574-d705-41f1-ac71-c1d2f114b45c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:27.875565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0966e574-d705-41f1-ac71-c1d2f114b45c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:27.876010 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0966e574-d705-41f1-ac71-c1d2f114b45c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:27.876723 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0966e574-d705-41f1-ac71-c1d2f114b45c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:27.877187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0966e574-d705-41f1-ac71-c1d2f114b45c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:27.877620 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0966e574-d705-41f1-ac71-c1d2f114b45c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:27.918271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0966e574-d705-41f1-ac71-c1d2f114b45c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059169 Aug 24 17:34:27.919054 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 470/1007] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:34:27 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:28.343165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1033842629", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aab8f8e0-cb67-414f-9024-f218c766fbc7"}], "security_groups": [{"name": "tempest-securitygroup--1328751220"}], "key_name": "tempest-keypair-441586037", "user_data": "}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:28.454138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] validate_networks() for [('aab8f8e0-cb67-414f-9024-f218c766fbc7', None, None, None, None, None)] {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:34:28.875449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:34:28.876055 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:34:28.876334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:34:28.876981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:34:28.877421 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:34:28.888038 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:28.888615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:28.889084 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:28.890147 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:28.890867 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:28.891728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:28.910780 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Getting quotas for project 6c8612c530e1495f8d6f4927560a9012. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:34:28.915551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Getting quotas for user ef9e96b709b345c08a4ea10f14211668 and project 6c8612c530e1495f8d6f4927560a9012. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:34:28.927390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:34:28.929885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:34:28.931629 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c934856f-a9c4-44d3-bf1f-c930836da024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:28.933673 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c934856f-a9c4-44d3-bf1f-c930836da024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:28.941338 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c934856f-a9c4-44d3-bf1f-c930836da024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:28.941835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c934856f-a9c4-44d3-bf1f-c930836da024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:28.942274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c934856f-a9c4-44d3-bf1f-c930836da024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:28.943010 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c934856f-a9c4-44d3-bf1f-c930836da024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:28.943469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c934856f-a9c4-44d3-bf1f-c930836da024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:28.943894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c934856f-a9c4-44d3-bf1f-c930836da024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:28.980167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c934856f-a9c4-44d3-bf1f-c930836da024 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053294 Aug 24 17:34:28.980758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 471/1008] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:34:28 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:34:29.056921 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-71d589ea-148b-49cf-9380-a90d38808d02 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.718539 Aug 24 17:34:29.058062 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 538/1009] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:34:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:34:29.073378 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2024af47-9bac-46ef-84a0-8a8aed6c2ccc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:29.074156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2024af47-9bac-46ef-84a0-8a8aed6c2ccc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:29.148234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2024af47-9bac-46ef-84a0-8a8aed6c2ccc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:29.162888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2024af47-9bac-46ef-84a0-8a8aed6c2ccc tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1237 microversion: 2.1 time: 0.096771 Aug 24 17:34:29.164051 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 472/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:29 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:30.000744 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b20f5be3-3467-4ec6-a2a6-9c795342d231 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:30.002845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b20f5be3-3467-4ec6-a2a6-9c795342d231 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:30.010631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b20f5be3-3467-4ec6-a2a6-9c795342d231 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:30.011150 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b20f5be3-3467-4ec6-a2a6-9c795342d231 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:30.011584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b20f5be3-3467-4ec6-a2a6-9c795342d231 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:30.012631 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b20f5be3-3467-4ec6-a2a6-9c795342d231 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:30.013141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b20f5be3-3467-4ec6-a2a6-9c795342d231 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:30.013561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b20f5be3-3467-4ec6-a2a6-9c795342d231 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:30.047919 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b20f5be3-3467-4ec6-a2a6-9c795342d231 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051915 Aug 24 17:34:30.048834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 539/1011] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:34:29 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:34:30.144658 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:30.145292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:30.152188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:30.152679 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:30.153124 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:30.153818 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:30.154273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:30.154699 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:30.191572 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:30.192213 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:30.198980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:30.203826 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:34:30.204187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:30.204187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:30.204187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:30.204187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:30.204721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:30.277795 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:30.285998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-34227c1f-96ee-49b5-bcaf-5bfa4901b642 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1241 microversion: 2.1 time: 0.098566 Aug 24 17:34:30.286571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 540/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:30 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:34:30.498146 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bcfe0f5b-4173-4c2c-a700-050f77df80df tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 204 len: 0 microversion: 2.1 time: 0.357862 Aug 24 17:34:30.498740 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 473/1013] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:34:30 2022] DELETE /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:34:30.507349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:30.508991 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:30.515524 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:30.516007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:30.516438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:30.517129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:30.517577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:30.518050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:30.689569 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:30.698804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-77ae0339-daee-4c8b-8034-3a153410039d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1690 microversion: 2.1 time: 0.195807 Aug 24 17:34:30.701022 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 541/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:30 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:34:31.308079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:31.308789 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:31.315849 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:31.316346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:31.316794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:31.317501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:31.317962 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:31.318417 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:31.398415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:31.407003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fff560d4-d636-4860-b851-60c286d0592f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1289 microversion: 2.1 time: 0.103219 Aug 24 17:34:31.407577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 474/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:31 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:31.721124 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:31.721722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:31.728575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:31.729068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:31.729510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:31.730224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:31.730706 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:31.731164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:31.882711 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:31.891769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-921f372e-f9f6-4019-96a2-2ca2d2f6179d tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1690 microversion: 2.1 time: 0.174654 Aug 24 17:34:31.892355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 542/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:31 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:32.429702 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:32.431344 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:32.438276 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:32.439096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:32.439546 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:32.440252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:32.440710 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:32.441135 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:32.514997 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:32.524671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-39bb5bba-efeb-41cd-aa8f-2ad9e01e7b63 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1289 microversion: 2.1 time: 0.099201 Aug 24 17:34:32.525699 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 475/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:32 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:32.916777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:32.917448 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:32.924115 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:32.924603 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:32.925040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:32.925746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:32.926202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:32.926624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:33.087659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:33.097712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1acd0100-d9d4-467b-af6a-ebd0470091f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1690 microversion: 2.1 time: 0.184844 Aug 24 17:34:33.098271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 543/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:32 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1690 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:33.555978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:33.556811 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:33.563421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:33.563908 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:33.564417 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:33.565091 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:33.565542 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:33.565956 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:33.644324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:33.653294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-94f4f2d9-c97a-49e7-8ec1-954da98d08a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1289 microversion: 2.1 time: 0.101745 Aug 24 17:34:33.653881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 476/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:33 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:34.120804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:34.121609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:34.128216 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:34.128711 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:34.129145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:34.129836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:34.130283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:34.130703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:34.276850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:34.285378 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8b1874d5-31f5-485d-836f-92e118be9118 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1690 microversion: 2.1 time: 0.169246 Aug 24 17:34:34.288913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 544/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:34 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:34.675462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:34.676083 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:34.683189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:34.683698 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:34.684142 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:34.684853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:34.685312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:34.685783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:34.753173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:34.761689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-067b679f-a04f-4216-98c4-3b31da67f201 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1289 microversion: 2.1 time: 0.090275 Aug 24 17:34:34.762232 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 477/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:34 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:35.316885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:35.317621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:35.326244 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:35.326734 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:35.327240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:35.328093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:35.328720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:35.329236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:35.610098 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:35.624185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a3ec41ee-f94f-458d-ba64-71b1a49d0e06 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1690 microversion: 2.1 time: 0.313355 Aug 24 17:34:35.625266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 545/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:35 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1690 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:35.784830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:35.785474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:35.794106 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:35.794612 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:35.795269 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:35.796064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:35.796543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:35.797960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:35.866002 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:35.878478 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4058e967-a1ef-4f75-949d-abef85a9ef8b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1295 microversion: 2.1 time: 0.098804 Aug 24 17:34:35.879440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 478/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:35 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:36.388463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-6a7a5155-6080-4063-adcf-3c158024eace req-63d9e150-f942-4c31-a917-5aea1d7396f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7feb685-67d6-4b7e-be2b-3e07e65391fb", "name": "network-vif-deleted", "tag": "67636d15-fa82-4271-bc02-ed3ff53fee97"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:36.411371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-6a7a5155-6080-4063-adcf-3c158024eace req-63d9e150-f942-4c31-a917-5aea1d7396f2 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:36.412707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-6a7a5155-6080-4063-adcf-3c158024eace req-63d9e150-f942-4c31-a917-5aea1d7396f2 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:36.413551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-6a7a5155-6080-4063-adcf-3c158024eace req-63d9e150-f942-4c31-a917-5aea1d7396f2 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:36.438324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-6a7a5155-6080-4063-adcf-3c158024eace req-63d9e150-f942-4c31-a917-5aea1d7396f2 service nova] Creating event network-vif-deleted:67636d15-fa82-4271-bc02-ed3ff53fee97 for instance d7feb685-67d6-4b7e-be2b-3e07e65391fb on hv-cinder-85164 Aug 24 17:34:36.457095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-6a7a5155-6080-4063-adcf-3c158024eace req-63d9e150-f942-4c31-a917-5aea1d7396f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068002 Aug 24 17:34:36.457095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 546/1024] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:36.653362 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:36.655096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:36.666551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:36.668015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:36.668542 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:36.669860 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:36.670946 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:36.671956 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:36.772001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:36.784099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4555c940-9e20-4520-8821-57c5916a76c6 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1331 microversion: 2.1 time: 0.139634 Aug 24 17:34:36.785356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 479/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:36 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1331 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:36.910259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:36.911286 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:36.921222 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:36.926589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:36.926589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:36.926589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:36.926589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:36.927111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:37.124690 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:37.125617 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:37.136619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ef3d3d5b-2425-463a-8cfa-4ff0f2b4f449 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1363 microversion: 2.1 time: 0.232339 Aug 24 17:34:37.137551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 547/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:36 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:37.351862 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ce69cc46-3f45-4209-b52e-eb583793e741 req-1fcc40e9-4655-4428-9fe7-cd1af155b152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099029bf-c329-4621-aa89-fa1e5513e667", "tag": "fcb808aa-e240-4d9a-aa4d-b616739ece07"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:37.367949 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ce69cc46-3f45-4209-b52e-eb583793e741 req-1fcc40e9-4655-4428-9fe7-cd1af155b152 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:37.368476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ce69cc46-3f45-4209-b52e-eb583793e741 req-1fcc40e9-4655-4428-9fe7-cd1af155b152 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:37.369794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ce69cc46-3f45-4209-b52e-eb583793e741 req-1fcc40e9-4655-4428-9fe7-cd1af155b152 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:37.397019 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ce69cc46-3f45-4209-b52e-eb583793e741 req-1fcc40e9-4655-4428-9fe7-cd1af155b152 service nova] Creating event network-changed:fcb808aa-e240-4d9a-aa4d-b616739ece07 for instance 099029bf-c329-4621-aa89-fa1e5513e667 on hv-cinder-85164 Aug 24 17:34:37.407260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ce69cc46-3f45-4209-b52e-eb583793e741 req-1fcc40e9-4655-4428-9fe7-cd1af155b152 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059538 Aug 24 17:34:37.408313 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 480/1027] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:34:37.814311 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:37.814881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:37.832144 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:37.837896 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:37.838657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:37.839610 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:37.843877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:37.844521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:37.900930 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:37.901421 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:37.901867 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:37.902997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lazy-loading 'fault' on Instance uuid d7feb685-67d6-4b7e-be2b-3e07e65391fb {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:34:37.956652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:37.965691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c65862f9-0a8d-4ed1-af15-2fd05c96cdba tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 200 len: 1336 microversion: 2.1 time: 0.155677 Aug 24 17:34:37.966285 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 548/1028] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:37 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:34:38.163422 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:38.165552 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:38.172130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:38.172632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:38.173070 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:38.173773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:38.174239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:38.174666 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:38.343225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:38.351883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-985a75f9-fe67-45a4-9f81-71864d61ce1d tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1363 microversion: 2.1 time: 0.192798 Aug 24 17:34:38.352562 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 481/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:38 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:38.992862 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:38.993883 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: d7feb685-67d6-4b7e-be2b-3e07e65391fb] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:38.996271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:38.996970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=6 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:39.003449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:39.003935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:39.008219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:39.008219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:39.008219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:39.008219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:39.032703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] HTTP exception thrown: Instance d7feb685-67d6-4b7e-be2b-3e07e65391fb could not be found. Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Request method failure captured: Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb HTTP/1.1 Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8leyUT8LR9_joBp5WcTRObVQ1206G5ZdQoG9THeHLiJNiHLOsvuazAWZKz1rXGxK2Kq6v_grcLjSgk1PqNuH-i8QeGG2CWBjJ8NnKmRjvoyTk79WH-fY3a7lhqHqbUNdoCRWQYR3F4c3wy8hXHbVz0rp6MFYehuyE9TI0_T4utcag Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:34:39.036008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf9b8b1e5c0f4021ae5f40c11c962222", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 0696e6f707274727b57a9a7493c47664 Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance d7feb685-67d6-4b7e-be2b-3e07e65391fb could not be found. Aug 24 17:34:39.037570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': 'd7feb685-67d6-4b7e-be2b-3e07e65391fb'} Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7feb685-67d6-4b7e-be2b-3e07e65391fb could not be found. Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:39.038445 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7feb685-67d6-4b7e-be2b-3e07e65391fb could not be found. Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7feb685-67d6-4b7e-be2b-3e07e65391fb could not be found. Aug 24 17:34:39.043807 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:39.045152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Returning 404 to user: Instance d7feb685-67d6-4b7e-be2b-3e07e65391fb could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:39.045152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bf8c0dae-f76b-490b-83a8-191dbb4f7466 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb" status: 404 len: 111 microversion: 2.1 time: 0.052296 Aug 24 17:34:39.045152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 549/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:38 2022] GET /compute/v2.1/servers/d7feb685-67d6-4b7e-be2b-3e07e65391fb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:34:39.048687 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2ba5dcd-356e-438b-be0e-16c5b7f14736 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '.version_select at 0x7f3f23eb30d0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:39.155677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:39.158338 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2ba5dcd-356e-438b-be0e-16c5b7f14736 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873813858" status: 202 len: 0 microversion: 2.1 time: 0.113461 Aug 24 17:34:39.159424 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 482/1031] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 24 17:34:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873813858 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:34:39.385802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:39.386417 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:39.395284 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:39.395792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:39.396203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:39.396899 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:39.397347 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:39.397767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:39.588213 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:39.596587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1101a44c-cb5c-452a-b6e7-31ec54c1a6a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1363 microversion: 2.1 time: 0.215326 Aug 24 17:34:39.597133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 550/1032] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:39 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:40.622392 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:40.623256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:40.625545 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:40.632181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:40.632686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:40.633130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:40.634407 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:40.634865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:40.635356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:40.797676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:40.808293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e2ab69b8-1689-458a-b5c2-d1508f46adf8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1363 microversion: 2.1 time: 0.190426 Aug 24 17:34:40.808896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 483/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:40 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:34:41.831373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:41.832421 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:41.835589 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:41.842258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:41.842935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:41.843449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:41.844286 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:41.845052 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:41.845581 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:42.016209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:42.026136 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c2a2b5a2-0021-419d-8ee3-0417ed84192b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1363 microversion: 2.1 time: 0.199178 Aug 24 17:34:42.026735 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 551/1034] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:41 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:42.844835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:42.845355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:42.851979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:42.853061 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:42.853565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:42.854189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:42.854637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:42.855083 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:42.882354 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:34:43.012209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:43.049938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:43.050809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:43.060863 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:43.061630 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:43.062300 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:43.063494 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:43.064200 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:43.064764 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:43.222017 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:43.230818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-08b9098e-d9f0-4162-9cc0-85dda7785b3e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1363 microversion: 2.1 time: 0.187637 Aug 24 17:34:43.231412 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 552/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:43 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:43.264825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7285e8b3-520b-4d2d-a971-f5171259725a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 204 len: 0 microversion: 2.1 time: 0.423498 Aug 24 17:34:43.265669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 484/1036] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:34:42 2022] DELETE /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:34:43.281275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:43.281925 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:43.288703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:43.289198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:43.290391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:43.291165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:43.291712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:43.292146 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:43.404105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8734464c-b353-4d34-a24d-5174d759e8cd req-171d7670-0b27-4550-9947-e045ac6dbe7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099029bf-c329-4621-aa89-fa1e5513e667", "name": "network-vif-plugged", "status": "completed", "tag": "fcb808aa-e240-4d9a-aa4d-b616739ece07"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:43.414312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8734464c-b353-4d34-a24d-5174d759e8cd req-171d7670-0b27-4550-9947-e045ac6dbe7f service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:43.415702 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8734464c-b353-4d34-a24d-5174d759e8cd req-171d7670-0b27-4550-9947-e045ac6dbe7f service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:43.416397 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8734464c-b353-4d34-a24d-5174d759e8cd req-171d7670-0b27-4550-9947-e045ac6dbe7f service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:43.431808 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8734464c-b353-4d34-a24d-5174d759e8cd req-171d7670-0b27-4550-9947-e045ac6dbe7f service nova] Creating event network-vif-plugged:fcb808aa-e240-4d9a-aa4d-b616739ece07 for instance 099029bf-c329-4621-aa89-fa1e5513e667 on hv-cinder-85164 Aug 24 17:34:43.437017 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8734464c-b353-4d34-a24d-5174d759e8cd req-171d7670-0b27-4550-9947-e045ac6dbe7f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038059 Aug 24 17:34:43.437835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 485/1037] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:34:43.455296 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:43.464141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-94ffdcb4-767f-4df5-8c6b-8fb02fecfe8e tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1508 microversion: 2.1 time: 0.186877 Aug 24 17:34:43.464730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 553/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:43 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:44.257866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:44.258508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:44.264877 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:44.265355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:44.265787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:44.266472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:44.266938 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:44.267361 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:44.414122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:44.423020 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-72f1b139-408d-4c1d-9bff-0daa7b01a475 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1363 microversion: 2.1 time: 0.169718 Aug 24 17:34:44.423627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 486/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:44 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:44.494460 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:44.495436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:44.503146 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:44.503642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:44.504130 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:44.504840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:44.505308 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:44.505733 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:44.651353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:44.659403 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e5fcad63-4f64-4663-8a8c-7267990a31f0 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1508 microversion: 2.1 time: 0.171118 Aug 24 17:34:44.659990 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 554/1040] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:44 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:44.807488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1616692482"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:44.807950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:44.814356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:44.814852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:44.815345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:44.816053 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:44.816512 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:44.816940 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:44.957548 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.network.security_group_api [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Removing security group 4a37194b-b203-4fa4-8143-5105b9a0ccd3 from port c45cd91b-3f4f-4af5-bc7b-065f2fa372d1 Aug 24 17:34:45.445235 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:45.446347 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:45.452829 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:45.453324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:45.453766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:45.454511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:45.455002 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:45.455485 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:45.586193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-75740ed3-ca28-4bfa-b1f9-db574f48c8d4 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "POST /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/action" status: 202 len: 0 microversion: 2.1 time: 0.782962 Aug 24 17:34:45.588021 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 487/1041] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:34:44 2022] POST /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/action => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:34:45.599396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ed7678e0-b156-49d2-a0d2-062398e5d2c7 req-e358d53d-401a-48b7-ae2e-8ac9d15e8e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22c94f29-0255-41b2-8d0e-9cb5b207b1c5", "tag": "c45cd91b-3f4f-4af5-bc7b-065f2fa372d1"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:45.620595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ed7678e0-b156-49d2-a0d2-062398e5d2c7 req-e358d53d-401a-48b7-ae2e-8ac9d15e8e4b service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:45.621547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ed7678e0-b156-49d2-a0d2-062398e5d2c7 req-e358d53d-401a-48b7-ae2e-8ac9d15e8e4b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:45.622446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ed7678e0-b156-49d2-a0d2-062398e5d2c7 req-e358d53d-401a-48b7-ae2e-8ac9d15e8e4b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:45.652980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ed7678e0-b156-49d2-a0d2-062398e5d2c7 req-e358d53d-401a-48b7-ae2e-8ac9d15e8e4b service nova] Creating event network-changed:c45cd91b-3f4f-4af5-bc7b-065f2fa372d1 for instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 on hv-cinder-85164 Aug 24 17:34:45.663224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ed7678e0-b156-49d2-a0d2-062398e5d2c7 req-e358d53d-401a-48b7-ae2e-8ac9d15e8e4b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067687 Aug 24 17:34:45.665932 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 488/1042] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:34:45.690443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:45.692248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:45.709601 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:45.711604 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:45.712679 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:45.714373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:45.715510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:45.716473 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:45.722983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:45.745329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4afaddd9-f2b7-44c8-b4b2-bd306bfee218 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1363 microversion: 2.1 time: 0.301322 Aug 24 17:34:45.749849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 555/1043] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:45 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:34:45.907262 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:45.926483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99552724-2ceb-4768-a6e7-2154ed934d1c tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1466 microversion: 2.1 time: 0.246828 Aug 24 17:34:45.927338 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 489/1044] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:45 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1466 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:46.776292 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:46.777074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:46.785069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:46.785738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:46.786349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:46.787265 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:46.787830 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:46.788315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:46.952715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:46.953440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:46.963350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:46.964152 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:46.964868 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:46.966033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:46.966795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:46.967565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:47.009417 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:47.009796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:47.010229 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:47.010693 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lazy-loading 'fault' on Instance uuid a4358625-1c72-482d-8701-670df9093271 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:34:47.247613 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:47.263761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47896b79-0b5c-44f3-847d-50ba85d2a85f tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 200 len: 1312 microversion: 2.1 time: 0.315879 Aug 24 17:34:47.264371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 490/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:46 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:34:47.339363 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:47.351381 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0fac76ad-17f2-441a-b77d-aab4d3f5c7d3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1363 microversion: 2.1 time: 0.580359 Aug 24 17:34:47.351998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 556/1046] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:46 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1363 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:47.629463 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:47.629956 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:47.637256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:47.637994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:47.638607 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:47.639520 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:47.639991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:47.640559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:47.690124 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-2a7b088f-090e-47e8-9968-cf1eed196085 req-0389f5ed-8c74-4bf3-a867-b8a24a556779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4358625-1c72-482d-8701-670df9093271", "name": "network-vif-deleted", "tag": "0de6314b-7979-44ff-97cf-61fca7107b27"}, {"name": "network-changed", "server_uuid": "22c94f29-0255-41b2-8d0e-9cb5b207b1c5", "tag": "c45cd91b-3f4f-4af5-bc7b-065f2fa372d1"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:47.707811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-2a7b088f-090e-47e8-9968-cf1eed196085 req-0389f5ed-8c74-4bf3-a867-b8a24a556779 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:47.708266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-2a7b088f-090e-47e8-9968-cf1eed196085 req-0389f5ed-8c74-4bf3-a867-b8a24a556779 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:47.708937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-2a7b088f-090e-47e8-9968-cf1eed196085 req-0389f5ed-8c74-4bf3-a867-b8a24a556779 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:47.723480 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-2a7b088f-090e-47e8-9968-cf1eed196085 req-0389f5ed-8c74-4bf3-a867-b8a24a556779 service nova] Creating event network-vif-deleted:0de6314b-7979-44ff-97cf-61fca7107b27 for instance a4358625-1c72-482d-8701-670df9093271 on hv-cinder-85164 Aug 24 17:34:47.724069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-2a7b088f-090e-47e8-9968-cf1eed196085 req-0389f5ed-8c74-4bf3-a867-b8a24a556779 service nova] Creating event network-changed:c45cd91b-3f4f-4af5-bc7b-065f2fa372d1 for instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 on hv-cinder-85164 Aug 24 17:34:47.731615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-2a7b088f-090e-47e8-9968-cf1eed196085 req-0389f5ed-8c74-4bf3-a867-b8a24a556779 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045202 Aug 24 17:34:47.732295 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 557/1047] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:34:47.748138 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lazy-loading 'services' on Instance uuid 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:34:48.006631 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a37888a9-8fa7-4107-9305-ff6473bb2fe1 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "DELETE /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments/1055fdc3-f235-4f83-87e9-5144e4afb7f5" status: 202 len: 0 microversion: 2.1 time: 0.381048 Aug 24 17:34:48.008152 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 491/1048] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:34:47 2022] DELETE /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments/1055fdc3-f235-4f83-87e9-5144e4afb7f5 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:34:48.025906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-772efe1b-9ba9-45cc-bb9f-f5155a8465c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:48.028356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-772efe1b-9ba9-45cc-bb9f-f5155a8465c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:48.041828 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-772efe1b-9ba9-45cc-bb9f-f5155a8465c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.042351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-772efe1b-9ba9-45cc-bb9f-f5155a8465c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.042774 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-772efe1b-9ba9-45cc-bb9f-f5155a8465c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.043881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-772efe1b-9ba9-45cc-bb9f-f5155a8465c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.044525 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-772efe1b-9ba9-45cc-bb9f-f5155a8465c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.045164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-772efe1b-9ba9-45cc-bb9f-f5155a8465c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.085503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-772efe1b-9ba9-45cc-bb9f-f5155a8465c0 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071556 Aug 24 17:34:48.087094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 558/1049] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:34:48 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:48.288041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:48.289368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: a4358625-1c72-482d-8701-670df9093271] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:48.301816 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.302201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.302652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.303516 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.303999 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.304488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.321826 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] HTTP exception thrown: Instance a4358625-1c72-482d-8701-670df9093271 could not be found. Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Request method failure captured: Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 HTTP/1.1 Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8leyUT8LR9_joBp5WcTRObVQ1206G5ZdQoG9THeHLiJNiHLOsvuazAWZKz1rXGxK2Kq6v_grcLjSgk1PqNuH-i8QeGG2CWBjJ8NnKmRjvoyTk79WH-fY3a7lhqHqbUNdoCRWQYR3F4c3wy8hXHbVz0rp6MFYehuyE9TI0_T4utcag Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:34:48.324271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf9b8b1e5c0f4021ae5f40c11c962222", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 0696e6f707274727b57a9a7493c47664 Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance a4358625-1c72-482d-8701-670df9093271 could not be found. Aug 24 17:34:48.327665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'a4358625-1c72-482d-8701-670df9093271'} Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4358625-1c72-482d-8701-670df9093271 could not be found. Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:48.330669 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4358625-1c72-482d-8701-670df9093271 could not be found. Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4358625-1c72-482d-8701-670df9093271 could not be found. Aug 24 17:34:48.333676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:48.337732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Returning 404 to user: Instance a4358625-1c72-482d-8701-670df9093271 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:48.337732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f7815a6-01ed-4a17-8bfc-db3b12a8caac tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271" status: 404 len: 111 microversion: 2.1 time: 0.042772 Aug 24 17:34:48.337732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 492/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:48 2022] GET /compute/v2.1/servers/a4358625-1c72-482d-8701-670df9093271 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:34:48.338307 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:48.338307 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:48.344223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.345004 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.345835 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.346970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.347804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.348574 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.375643 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:48.376614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:48.386597 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.386895 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:34:48.387353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.388028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.389107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.389909 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.390352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.562539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:48.570612 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-783d2d65-31c0-489c-80e4-79bf2bc976d2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1548 microversion: 2.1 time: 0.201256 Aug 24 17:34:48.577762 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 493/1051] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:48 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1548 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:48.592522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f1783f6-d93d-456a-996b-67bcdc23bb9c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:48.592888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f1783f6-d93d-456a-996b-67bcdc23bb9c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:48.599783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1783f6-d93d-456a-996b-67bcdc23bb9c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.600269 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1783f6-d93d-456a-996b-67bcdc23bb9c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.600703 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1783f6-d93d-456a-996b-67bcdc23bb9c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.601405 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1783f6-d93d-456a-996b-67bcdc23bb9c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.601854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1783f6-d93d-456a-996b-67bcdc23bb9c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.602313 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f1783f6-d93d-456a-996b-67bcdc23bb9c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.700596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f1783f6-d93d-456a-996b-67bcdc23bb9c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112263 Aug 24 17:34:48.701390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 494/1052] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 24 17:34:48 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:48.750841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fff583cf-cd77-45d2-8ca8-e136e2dc20c5 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "DELETE /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 204 len: 0 microversion: 2.1 time: 0.420258 Aug 24 17:34:48.752287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 559/1053] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:34:48 2022] DELETE /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:34:48.764576 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:48.765714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:48.775074 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.775584 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.777465 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:48.778596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:48.779275 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:48.780018 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:49.073034 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:49.082197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6d5afbd-d3d2-411f-97fe-3afc596e7277 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.324470 Aug 24 17:34:49.082796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 495/1054] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:48 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:49.100680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-92683c73-3093-437e-928c-45802968465f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:49.103883 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-92683c73-3093-437e-928c-45802968465f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:49.111172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92683c73-3093-437e-928c-45802968465f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:49.111662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92683c73-3093-437e-928c-45802968465f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:49.112100 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92683c73-3093-437e-928c-45802968465f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:49.112894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92683c73-3093-437e-928c-45802968465f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:49.113337 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92683c73-3093-437e-928c-45802968465f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:49.113765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-92683c73-3093-437e-928c-45802968465f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:49.156435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-92683c73-3093-437e-928c-45802968465f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061595 Aug 24 17:34:49.157262 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 560/1055] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:34:49 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:49.993246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-e9c082a5-e0db-475f-9426-e06817072838 req-b4258219-ba5c-49ed-8c23-a16b7efc76c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099029bf-c329-4621-aa89-fa1e5513e667", "tag": "fcb808aa-e240-4d9a-aa4d-b616739ece07"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:50.006445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e9c082a5-e0db-475f-9426-e06817072838 req-b4258219-ba5c-49ed-8c23-a16b7efc76c3 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:50.009362 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e9c082a5-e0db-475f-9426-e06817072838 req-b4258219-ba5c-49ed-8c23-a16b7efc76c3 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:50.009362 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-e9c082a5-e0db-475f-9426-e06817072838 req-b4258219-ba5c-49ed-8c23-a16b7efc76c3 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:50.023054 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-e9c082a5-e0db-475f-9426-e06817072838 req-b4258219-ba5c-49ed-8c23-a16b7efc76c3 service nova] Creating event network-changed:fcb808aa-e240-4d9a-aa4d-b616739ece07 for instance 099029bf-c329-4621-aa89-fa1e5513e667 on hv-cinder-85164 Aug 24 17:34:50.028564 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-e9c082a5-e0db-475f-9426-e06817072838 req-b4258219-ba5c-49ed-8c23-a16b7efc76c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040136 Aug 24 17:34:50.029795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 496/1056] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:50.103645 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:50.104997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:50.113486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:50.114655 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:50.115687 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:50.118070 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:50.119322 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:50.119992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:50.173571 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-90471d68-417f-44a0-8d03-b576d25da30d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:50.182847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-90471d68-417f-44a0-8d03-b576d25da30d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:50.191695 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90471d68-417f-44a0-8d03-b576d25da30d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:50.192519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90471d68-417f-44a0-8d03-b576d25da30d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:50.193223 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90471d68-417f-44a0-8d03-b576d25da30d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:50.194406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90471d68-417f-44a0-8d03-b576d25da30d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:50.195111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90471d68-417f-44a0-8d03-b576d25da30d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:50.196305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-90471d68-417f-44a0-8d03-b576d25da30d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:50.240141 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-90471d68-417f-44a0-8d03-b576d25da30d tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073359 Aug 24 17:34:50.247225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 497/1057] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:34:50 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:34:50.255080 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:50.256875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:50.267394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:50.269758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:50.270459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:50.272401 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:50.272917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:50.273820 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:50.370989 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:50.379609 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] HTTP exception thrown: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 is not attached to volume 1055fdc3-f235-4f83-87e9-5144e4afb7f5 Aug 24 17:34:50.382643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-07d076ab-c29f-4d26-ab77-322e9a114f90 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1520 microversion: 2.1 time: 0.281000 Aug 24 17:34:50.382643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 561/1058] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:50 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Request method failure captured: Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments/1055fdc3-f235-4f83-87e9-5144e4afb7f5 HTTP/1.1 Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBmAJnaY2Dpvjmx3zkqdzEb3eV3CxR7malJzwZCAn8hQo5ll1Hg4nK1a1QV3D-xzsbtcxJAtJWHxVB3vawCq2SLdRpgojUpzB6p44JktBcOJjJrMO12T7TYtp-FAe-gC9fj9AtX3Tv1qpEEG8MlBosRp00HocCCtWFF_zu49h9vhT6dc Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 95cbbaf120e848a0a699fd6391aebcfd Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-TestMinimumBasicScenario-136513280 Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:34:50.388792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/95cbbaf120e848a0a699fd6391aebcfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/95cbbaf120e848a0a699fd6391aebcfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_95cbbaf120e848a0a699fd6391aebcfd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/95cbbaf120e848a0a699fd6391aebcfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-TestMinimumBasicScenario-136513280 Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 95cbbaf120e848a0a699fd6391aebcfd Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestMinimumBasicScenario-136513280 Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-TestMinimumBasicScenario-136513280-project Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 78ce397b5ece4c5b81a1bbefcf87df9d Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-TestMinimumBasicScenario-136513280-project Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:34:50.390639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 is not attached to volume 1055fdc3-f235-4f83-87e9-5144e4afb7f5 Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'server_id': '22c94f29-0255-41b2-8d0e-9cb5b207b1c5', 'id': '1055fdc3-f235-4f83-87e9-5144e4afb7f5'} Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1055fdc3-f235-4f83-87e9-5144e4afb7f5. Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:50.391532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 is not attached to volume 1055fdc3-f235-4f83-87e9-5144e4afb7f5 Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 is not attached to volume 1055fdc3-f235-4f83-87e9-5144e4afb7f5 Aug 24 17:34:50.393927 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:34:50.397285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Returning 404 to user: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 is not attached to volume 1055fdc3-f235-4f83-87e9-5144e4afb7f5 {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:50.398675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-00814f9a-32ee-44b1-9b16-82ff7db9247c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "DELETE /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments/1055fdc3-f235-4f83-87e9-5144e4afb7f5" status: 404 len: 154 microversion: 2.1 time: 0.149410 Aug 24 17:34:50.403214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 498/1059] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:34:50 2022] DELETE /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5/os-volume_attachments/1055fdc3-f235-4f83-87e9-5144e4afb7f5 => generated 154 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:34:50.759083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-7e04922b-07fa-4cf3-ace2-af56670aa32f req-862385f9-f8bc-4c55-999f-c635b864b9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509a6e8e-d774-492b-9618-7de5caf2955f", "name": "network-vif-deleted", "tag": "27819313-e232-4d79-a507-dd2f39913292"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:50.771675 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-7e04922b-07fa-4cf3-ace2-af56670aa32f req-862385f9-f8bc-4c55-999f-c635b864b9ac service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:50.773384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-7e04922b-07fa-4cf3-ace2-af56670aa32f req-862385f9-f8bc-4c55-999f-c635b864b9ac service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:50.795811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-7e04922b-07fa-4cf3-ace2-af56670aa32f req-862385f9-f8bc-4c55-999f-c635b864b9ac service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:50.795811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-7e04922b-07fa-4cf3-ace2-af56670aa32f req-862385f9-f8bc-4c55-999f-c635b864b9ac service nova] Creating event network-vif-deleted:27819313-e232-4d79-a507-dd2f39913292 for instance 509a6e8e-d774-492b-9618-7de5caf2955f on hv-cinder-85164 Aug 24 17:34:50.802389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-7e04922b-07fa-4cf3-ace2-af56670aa32f req-862385f9-f8bc-4c55-999f-c635b864b9ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048086 Aug 24 17:34:50.803674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 562/1060] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:51.409001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:51.409626 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:51.416570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:51.417075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:51.417523 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:51.418243 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:51.418702 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:51.419193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:51.459145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:51.459638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:51.460087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:51.460550 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lazy-loading 'fault' on Instance uuid 509a6e8e-d774-492b-9618-7de5caf2955f {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:34:51.504803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0696e6f707274727b57a9a7493c47664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9b8b1e5c0f4021ae5f40c11c962222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:51.513898 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-839a8005-9e60-4932-8bd3-53bbdb32384a tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 200 len: 1310 microversion: 2.1 time: 0.108957 Aug 24 17:34:51.514483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 499/1061] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:51 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:51.831655 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:51.833127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:51.839164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:51.839655 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:51.840094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:51.840786 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:51.841387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:51.841928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:51.868025 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:34:51.892895 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:34:52.423870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8d95d06c-0842-44e2-8699-08d2e77a6570 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "DELETE /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 204 len: 0 microversion: 2.1 time: 0.596716 Aug 24 17:34:52.424384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 563/1062] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:34:51 2022] DELETE /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:34:52.432872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:52.433639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:52.441532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:52.442029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:52.442480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:52.443218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:52.443678 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:52.444103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:52.537240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:52.538107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] [instance: 509a6e8e-d774-492b-9618-7de5caf2955f] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:52.549888 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:52.550467 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:52.552681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:52.553576 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:52.554059 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:52.554547 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:52.569595 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] HTTP exception thrown: Instance 509a6e8e-d774-492b-9618-7de5caf2955f could not be found. Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Request method failure captured: Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f HTTP/1.1 Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8leyUT8LR9_joBp5WcTRObVQ1206G5ZdQoG9THeHLiJNiHLOsvuazAWZKz1rXGxK2Kq6v_grcLjSgk1PqNuH-i8QeGG2CWBjJ8NnKmRjvoyTk79WH-fY3a7lhqHqbUNdoCRWQYR3F4c3wy8hXHbVz0rp6MFYehuyE9TI0_T4utcag Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:34:52.572014 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf9b8b1e5c0f4021ae5f40c11c962222", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf9b8b1e5c0f4021ae5f40c11c962222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: cf9b8b1e5c0f4021ae5f40c11c962222 Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1586426916 Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 0696e6f707274727b57a9a7493c47664 Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1586426916-project Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 509a6e8e-d774-492b-9618-7de5caf2955f could not be found. Aug 24 17:34:52.573728 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '509a6e8e-d774-492b-9618-7de5caf2955f'} Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 509a6e8e-d774-492b-9618-7de5caf2955f could not be found. Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:52.574503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 509a6e8e-d774-492b-9618-7de5caf2955f could not be found. Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 509a6e8e-d774-492b-9618-7de5caf2955f could not be found. Aug 24 17:34:52.575880 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:52.577122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] Returning 404 to user: Instance 509a6e8e-d774-492b-9618-7de5caf2955f could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:52.577122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-33311742-4d7f-400a-9eed-cc7e077ab477 tempest-ServerRescueNegativeTestJSON-1586426916 tempest-ServerRescueNegativeTestJSON-1586426916-project] 10.222.0.18 "GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f" status: 404 len: 111 microversion: 2.1 time: 0.041421 Aug 24 17:34:52.577122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 564/1063] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:52 2022] GET /compute/v2.1/servers/509a6e8e-d774-492b-9618-7de5caf2955f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:34:52.601671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:52.611919 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3feaebc5-ec01-4338-a091-8f75ad680a30 tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1554 microversion: 2.1 time: 0.182933 Aug 24 17:34:52.612623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 500/1064] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:52 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:53.700889 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:53.701508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:53.708577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:53.709071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:53.709511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:53.710245 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:53.710702 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:53.711668 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:53.863354 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:53.872060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fcf645fa-4fa1-43c6-bb2c-859a0707b37f tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1554 microversion: 2.1 time: 0.175752 Aug 24 17:34:53.872694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 565/1065] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:53 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:54.892659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:54.895291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:54.901332 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:54.901826 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:54.902271 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:54.903106 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:54.903469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:54.903903 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:55.081180 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:55.093392 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-feb35bb0-ae6c-466f-aff0-dbe3b81e8ead tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1554 microversion: 2.1 time: 0.204605 Aug 24 17:34:55.107735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 501/1066] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:54 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:55.791908 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-fec21cae-222b-4335-ba60-d85ba6f20ca1 req-bbeddb4a-24f8-46dd-87a7-8c6cdc203fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22c94f29-0255-41b2-8d0e-9cb5b207b1c5", "name": "network-vif-deleted", "tag": "c45cd91b-3f4f-4af5-bc7b-065f2fa372d1"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:34:55.802640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-fec21cae-222b-4335-ba60-d85ba6f20ca1 req-bbeddb4a-24f8-46dd-87a7-8c6cdc203fc2 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:55.803128 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-fec21cae-222b-4335-ba60-d85ba6f20ca1 req-bbeddb4a-24f8-46dd-87a7-8c6cdc203fc2 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:55.803791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-fec21cae-222b-4335-ba60-d85ba6f20ca1 req-bbeddb4a-24f8-46dd-87a7-8c6cdc203fc2 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:55.817294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-fec21cae-222b-4335-ba60-d85ba6f20ca1 req-bbeddb4a-24f8-46dd-87a7-8c6cdc203fc2 service nova] Creating event network-vif-deleted:c45cd91b-3f4f-4af5-bc7b-065f2fa372d1 for instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 on hv-cinder-85164 Aug 24 17:34:55.822711 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-fec21cae-222b-4335-ba60-d85ba6f20ca1 req-bbeddb4a-24f8-46dd-87a7-8c6cdc203fc2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035431 Aug 24 17:34:55.826390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 566/1067] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:34:56.115762 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:56.116538 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:56.124009 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:56.124520 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:56.124966 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:56.125690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:56.126148 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:56.126579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:56.237804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ce397b5ece4c5b81a1bbefcf87df9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cbbaf120e848a0a699fd6391aebcfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:34:56.254209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a9f6932-1f89-4beb-99d8-c8006ea4aa5b tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 200 len: 1343 microversion: 2.1 time: 0.142264 Aug 24 17:34:56.255958 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 502/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:56 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 1343 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:34:57.282568 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:57.283339 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] [instance: 22c94f29-0255-41b2-8d0e-9cb5b207b1c5] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:34:57.292981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:57.293674 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:57.294226 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:57.295272 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:34:57.295821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:34:57.296503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:34:57.327119 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] HTTP exception thrown: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 could not be found. Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Request method failure captured: Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 HTTP/1.1 Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBmAJnaY2Dpvjmx3zkqdzEb3eV3CxR7malJzwZCAn8hQo5ll1Hg4nK1a1QV3D-xzsbtcxJAtJWHxVB3vawCq2SLdRpgojUpzB6p44JktBcOJjJrMO12T7TYtp-FAe-gC9fj9AtX3Tv1qpEEG8MlBosRp00HocCCtWFF_zu49h9vhT6dc Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 95cbbaf120e848a0a699fd6391aebcfd Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-TestMinimumBasicScenario-136513280 Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:34:57.328859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/95cbbaf120e848a0a699fd6391aebcfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/95cbbaf120e848a0a699fd6391aebcfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_95cbbaf120e848a0a699fd6391aebcfd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/95cbbaf120e848a0a699fd6391aebcfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-TestMinimumBasicScenario-136513280 Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 95cbbaf120e848a0a699fd6391aebcfd Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-TestMinimumBasicScenario-136513280 Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-TestMinimumBasicScenario-136513280-project Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 78ce397b5ece4c5b81a1bbefcf87df9d Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-TestMinimumBasicScenario-136513280-project Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 could not be found. Aug 24 17:34:57.333556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '22c94f29-0255-41b2-8d0e-9cb5b207b1c5'} Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 could not be found. Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:34:57.335073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 could not be found. Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 could not be found. Aug 24 17:34:57.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:34:57.338810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Returning 404 to user: Instance 22c94f29-0255-41b2-8d0e-9cb5b207b1c5 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:34:57.338810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8a36caef-ea61-47e4-a9ef-b935526919bd tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5" status: 404 len: 111 microversion: 2.1 time: 0.052930 Aug 24 17:34:57.343808 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4836e53a-8dbb-44f1-bf42-686f8ea80a6c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] Calling method '.version_select at 0x7f3f23f21e50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:34:57.347320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 567/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:34:57 2022] GET /compute/v2.1/servers/22c94f29-0255-41b2-8d0e-9cb5b207b1c5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:34:57.431241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4836e53a-8dbb-44f1-bf42-686f8ea80a6c tempest-TestMinimumBasicScenario-136513280 tempest-TestMinimumBasicScenario-136513280-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1875251951" status: 202 len: 0 microversion: 2.1 time: 0.092771 Aug 24 17:34:57.435309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 503/1070] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Aug 24 17:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1875251951 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:35:24.909805 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:35:24.910915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:35:25.138353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4b27a4b1-a773-4e03-84e8-de93799ace64 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Action: 'create', calling method: .version_select at 0x7f3f345e31f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1730836924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhOFPHQrrXZdU1ASVqVWE3W0bGoSu4InuEtQmpxRckh7+hAM+xtDs2lVdLkMLZf9LRL9qgHP9OYqMx2uN1pTUq3Qt8NawN+a+1yqbOpSdqjGfXkThmbQ9CnNKasO0FYxQ=="}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:35:25.155293 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-4b27a4b1-a773-4e03-84e8-de93799ace64 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Getting quotas for project 2a66fdbac83c47b59c88adbe6b82ff8a. Resources: {'key_pairs'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:35:25.159394 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-4b27a4b1-a773-4e03-84e8-de93799ace64 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Getting quotas for user 4df56db015514caa8aa92ffcfe227914 and project 2a66fdbac83c47b59c88adbe6b82ff8a. Resources: {'key_pairs'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:35:25.294093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4b27a4b1-a773-4e03-84e8-de93799ace64 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.389459 Aug 24 17:35:25.294691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 568/1071] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:35:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:36:01.234343 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:36:01.239290 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Wed Aug 24 17:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:36:13.799553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:13.800373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:13.805157 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2104186248", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1730836924", "security_groups": [{"name": "tempest-secgroup-smoke-629147115"}], "networks": [{"uuid": "0a43125d-b237-4d32-a8cc-ebd64e53eb4c"}], "block_device_mapping_v2": [{"uuid": "3d1e313f-8e92-45af-89c9-5d39f52bb3e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:14.036302 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] validate_networks() for [('0a43125d-b237-4d32-a8cc-ebd64e53eb4c', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:36:14.164508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=4 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:14.169591 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1725499855", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-898876491", "security_groups": [{"name": "tempest-secgroup-smoke-561477544"}], "block_device_mapping_v2": [{"uuid": "47df8da2-91bc-4563-acd9-06adb319efaf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5acc8120-3236-4503-932d-c28186671d3c"}]}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:14.410286 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] validate_networks() for [('5acc8120-3236-4503-932d-c28186671d3c', None, None, None, None, None)] {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:36:14.591608 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:36:14.592030 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:36:14.592500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:36:14.592902 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:36:14.593307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:36:14.603234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:14.604604 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:14.604604 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:14.605155 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:14.605597 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:14.606027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:14.624026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Getting quotas for project 2a66fdbac83c47b59c88adbe6b82ff8a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:36:14.628333 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Getting quotas for user 4df56db015514caa8aa92ffcfe227914 and project 2a66fdbac83c47b59c88adbe6b82ff8a. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:36:14.696376 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:36:14.698680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d1e313f-8e92-45af-89c9-5d39f52bb3e1',volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:36:14.901813 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:36:14.902237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:36:14.902712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:36:14.903177 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:36:14.903591 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:36:14.912473 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:14.912951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:14.913384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:14.914101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:14.914550 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:14.915000 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:14.931713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Getting quotas for project 036fc4bf065249e29d0e1e90d23bae19. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:36:14.935633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Getting quotas for user 47da700d7d0f4d5cb1ea984a82d643bf and project 036fc4bf065249e29d0e1e90d23bae19. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:36:14.995169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:36:14.997368 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47df8da2-91bc-4563-acd9-06adb319efaf',volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:36:15.256118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-66a91e18-6fa1-4b6c-a9f6-92121bf269bf tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.458371 Aug 24 17:36:15.257012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 504/1072] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:36:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:36:15.267610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-14b36ea4-37b1-4cad-b944-bc6c027b3e94 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:15.268224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-14b36ea4-37b1-4cad-b944-bc6c027b3e94 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:15.324215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-14b36ea4-37b1-4cad-b944-bc6c027b3e94 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:15.331241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-14b36ea4-37b1-4cad-b944-bc6c027b3e94 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1089 microversion: 2.1 time: 0.067413 Aug 24 17:36:15.331814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 505/1073] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:15 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:15.576509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5974e716-5d2e-4b2a-b738-395110a15d4d tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.413317 Aug 24 17:36:15.582930 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 569/1074] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:36:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:36:15.588285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b336bc39-ae08-4dfd-bb51-6175f113cdab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:15.588899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b336bc39-ae08-4dfd-bb51-6175f113cdab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:15.658212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b336bc39-ae08-4dfd-bb51-6175f113cdab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:15.662217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b336bc39-ae08-4dfd-bb51-6175f113cdab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1094 microversion: 2.1 time: 0.077753 Aug 24 17:36:15.663075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 506/1075] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:15 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:16.353008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-081fe24d-b2cb-4d66-9072-c7081b247406 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:16.353791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-081fe24d-b2cb-4d66-9072-c7081b247406 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:16.413388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-081fe24d-b2cb-4d66-9072-c7081b247406 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:16.420536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-081fe24d-b2cb-4d66-9072-c7081b247406 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1089 microversion: 2.1 time: 0.073317 Aug 24 17:36:16.421127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 570/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:16 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:16.682094 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3d69145a-231f-4ed4-886a-2085c6e62f79 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:16.682640 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3d69145a-231f-4ed4-886a-2085c6e62f79 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:16.751120 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3d69145a-231f-4ed4-886a-2085c6e62f79 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:16.758769 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3d69145a-231f-4ed4-886a-2085c6e62f79 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1094 microversion: 2.1 time: 0.080607 Aug 24 17:36:16.759357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 507/1077] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:16 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:17.444392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:17.445284 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:17.452511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:17.452995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:17.453428 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:17.454118 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:17.454568 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:17.455058 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:17.517811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:17.526532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ccf1652c-391d-49c4-a49d-22ddbfade572 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1131 microversion: 2.1 time: 0.088980 Aug 24 17:36:17.527143 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 571/1078] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:17 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1131 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:17.780358 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:17.780913 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:17.789012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:17.789775 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:17.790408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:17.791305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:17.791920 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:17.792637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:17.862517 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:17.870617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e98bd91-cf30-4241-a10b-030c35262456 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1192 microversion: 2.1 time: 0.094537 Aug 24 17:36:17.871498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 508/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:17 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:18.553577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:18.554249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:18.562155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:18.562953 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:18.563643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:18.565201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:18.567316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:18.568046 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:18.666943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:18.679802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fe83f430-ee2c-4c16-97af-922bf569e8c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1195 microversion: 2.1 time: 0.134548 Aug 24 17:36:18.680997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 572/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:18 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1195 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:18.893977 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:18.894806 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:18.904889 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:18.905976 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:18.907334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:18.908341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:18.910704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:18.911416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:19.038931 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:19.044162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9fa35d93-0442-469a-af7b-ded95a940560 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1200 microversion: 2.1 time: 0.153992 Aug 24 17:36:19.049565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 509/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:18 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1200 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:19.705959 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:19.708020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:19.716623 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:19.717511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:19.718122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:19.719413 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:19.720202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:19.720735 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:20.008783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:20.021562 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-41680aeb-9bd7-4c20-b541-a6cf5ea6007f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1272 microversion: 2.1 time: 0.318475 Aug 24 17:36:20.024073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 573/1082] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:19 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1272 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:20.076635 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:20.077923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:20.086647 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:20.087346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:20.088020 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:20.089047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:20.089905 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:20.091123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:20.380434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:20.391435 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b1b08abc-f1d4-4315-93a8-976dbdaf46ee tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1277 microversion: 2.1 time: 0.318571 Aug 24 17:36:20.392204 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 510/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:20 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1277 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:20.719487 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-d94048a8-464a-44db-beb2-055e87969c9b req-fe552df7-9c6d-4a37-91ee-d09337bec596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d", "tag": "6ad650fb-2ab0-4c92-bbe5-467990c85e47"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:20.731645 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-d94048a8-464a-44db-beb2-055e87969c9b req-fe552df7-9c6d-4a37-91ee-d09337bec596 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:20.732402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-d94048a8-464a-44db-beb2-055e87969c9b req-fe552df7-9c6d-4a37-91ee-d09337bec596 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:20.732986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-d94048a8-464a-44db-beb2-055e87969c9b req-fe552df7-9c6d-4a37-91ee-d09337bec596 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:20.746718 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-d94048a8-464a-44db-beb2-055e87969c9b req-fe552df7-9c6d-4a37-91ee-d09337bec596 service nova] Creating event network-changed:6ad650fb-2ab0-4c92-bbe5-467990c85e47 for instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d on hv-cinder-85164 Aug 24 17:36:20.756363 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-d94048a8-464a-44db-beb2-055e87969c9b req-fe552df7-9c6d-4a37-91ee-d09337bec596 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041786 Aug 24 17:36:20.757601 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 574/1084] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:36:21.043986 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:21.044437 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:21.057789 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:21.058321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:21.061595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:21.063925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:21.064215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:21.064668 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:21.088387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-0e62ab0c-6b98-437b-b2ac-ae3fcce085b3 req-50b97544-b645-49d4-ae2e-24fd54777862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a7e303-08e1-4970-a0c8-e30d82054b93", "tag": "2b921a7d-2dbb-4c33-a5ee-bf04279355e3"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:21.109280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-0e62ab0c-6b98-437b-b2ac-ae3fcce085b3 req-50b97544-b645-49d4-ae2e-24fd54777862 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:21.116257 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-0e62ab0c-6b98-437b-b2ac-ae3fcce085b3 req-50b97544-b645-49d4-ae2e-24fd54777862 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:21.116257 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-0e62ab0c-6b98-437b-b2ac-ae3fcce085b3 req-50b97544-b645-49d4-ae2e-24fd54777862 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:21.134624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-0e62ab0c-6b98-437b-b2ac-ae3fcce085b3 req-50b97544-b645-49d4-ae2e-24fd54777862 service nova] Creating event network-changed:2b921a7d-2dbb-4c33-a5ee-bf04279355e3 for instance 68a7e303-08e1-4970-a0c8-e30d82054b93 on hv-cinder-85164 Aug 24 17:36:21.142686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-0e62ab0c-6b98-437b-b2ac-ae3fcce085b3 req-50b97544-b645-49d4-ae2e-24fd54777862 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056611 Aug 24 17:36:21.142686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 575/1085] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:36:21.325543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:21.335134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bbebd7e0-f081-439f-a202-a750ebe11887 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.295855 Aug 24 17:36:21.335971 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 511/1086] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:21 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:21.415407 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:21.416304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:21.430220 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:21.432255 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:21.433225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:21.434823 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:21.436054 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:21.436559 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:21.670474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:21.679795 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-869d1bd3-b50f-47e7-b5ef-4ab43554913b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1277 microversion: 2.1 time: 0.268024 Aug 24 17:36:21.680860 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 576/1087] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:21 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:22.356708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:22.357508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:22.365810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:22.366442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:22.366935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:22.368530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:22.368530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:22.368988 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:22.563350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:22.575559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-de3d1686-6f3f-402f-9764-be780ac91004 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.218580 Aug 24 17:36:22.575559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 512/1088] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:22 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:22.702162 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:22.703080 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:22.709234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:22.713032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:22.713032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:22.713032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:22.713032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:22.713414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:22.869703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:22.877938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3a7722c6-44d5-499f-9420-ab81a7cd2ce5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.179608 Aug 24 17:36:22.878542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 577/1089] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:22 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:23.591657 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:23.592270 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:23.598981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:23.599444 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:23.599949 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:23.600653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:23.601109 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:23.601539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:23.746892 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:23.755799 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-08108135-1d52-456d-b497-0c3bdea957ae tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.168033 Aug 24 17:36:23.756370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 513/1090] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:23 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:23.904166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:23.905671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:23.913449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:23.913986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:23.914505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:23.915255 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:23.915698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:23.916114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:24.081215 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:24.089967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2488ffe6-c697-441b-adad-bdaefc3b4caa tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.192094 Aug 24 17:36:24.090879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 578/1091] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:23 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:24.615577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:24.712370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2e238284-cc9c-4b67-a7b2-3d5e3f34ad24 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:24.718566 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2e238284-cc9c-4b67-a7b2-3d5e3f34ad24 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:24.719241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e238284-cc9c-4b67-a7b2-3d5e3f34ad24 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:24.719740 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e238284-cc9c-4b67-a7b2-3d5e3f34ad24 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:24.720178 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e238284-cc9c-4b67-a7b2-3d5e3f34ad24 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:24.720881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e238284-cc9c-4b67-a7b2-3d5e3f34ad24 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:24.721342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e238284-cc9c-4b67-a7b2-3d5e3f34ad24 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:24.721777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2e238284-cc9c-4b67-a7b2-3d5e3f34ad24 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:24.749781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2e238284-cc9c-4b67-a7b2-3d5e3f34ad24 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/ips" status: 200 len: 152 microversion: 2.20 time: 0.289690 Aug 24 17:36:24.750335 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 514/1092] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Aug 24 17:36:24 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/ips => generated 152 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:36:24.779615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:24.780086 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:24.788420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:24.788420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:24.788420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:24.789905 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:24.790418 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:24.791129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:24.922380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:24.960021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:24.968853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ec245dc2-62da-450b-b364-05087ee89e19 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.194116 Aug 24 17:36:24.974302 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 579/1093] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:24 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:25.111651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:25.112264 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:25.119259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:25.119751 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:25.120193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:25.120887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:25.121344 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:25.121771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:25.294199 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:25.303029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a4d952d-9ab0-4ed2-bbc6-16c8044bb054 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.195153 Aug 24 17:36:25.306455 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 515/1094] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:25 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:25.996796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:25.997511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:26.004878 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:26.005387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:26.005836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:26.006558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:26.007052 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:26.007484 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:26.164632 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:26.173471 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3feb921a-1eba-4b8f-88b8-b2bdeb1cd60b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.181303 Aug 24 17:36:26.174061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 580/1095] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:25 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:26.325228 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:26.325887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:26.333352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:26.334865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:26.334865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:26.335717 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:26.336202 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:26.336641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:26.488828 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:26.497317 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-37d3e364-db7f-4ba5-b7ba-712fae3a608f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.175924 Aug 24 17:36:26.497911 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 516/1096] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:26 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:27.194288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:27.195029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:27.196970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=8 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:27.202492 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:27.203107 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:27.203459 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:27.204343 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:27.204695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:27.205069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:27.388932 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:27.403132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-27d07613-ed2e-4d90-a89b-3e50907c8b3a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.212401 Aug 24 17:36:27.410194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 581/1097] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:27 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:27.525530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:27.526296 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:27.528715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:27.534324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:27.534868 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:27.535329 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:27.536023 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:27.536477 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:27.536930 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:27.695773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:27.703819 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b54b8d5c-71cd-4431-8c73-8e849ee9aa0a tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.182464 Aug 24 17:36:27.704439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 517/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:27 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:28.426834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:28.427478 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:28.434634 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:28.435162 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:28.435603 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:28.436304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:28.436760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:28.437184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:28.589585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:28.597061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-35ec8f48-63e1-446d-9043-85183330aa53 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.174106 Aug 24 17:36:28.597642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 582/1099] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:28 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:28.665529 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:28.665529 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:28.672232 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:28.672731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:28.673168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:28.673873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:28.674322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:28.674752 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:28.699648 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lazy-loading 'flavor' on Instance uuid 127fd694-1843-4ba5-97aa-2565c01c30c2 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:36:28.731609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:28.732219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:28.738946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:28.743383 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:28.743383 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:28.743383 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:28.743383 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:28.743962 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:28.905776 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:28.915236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f705d8bd-77f6-41e2-828f-68b5ddafd3bd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.186502 Aug 24 17:36:28.915236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 583/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:28 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:29.560017 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7718e9bd-d2a1-4cfb-8bfe-848496e7d2df tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/action" status: 202 len: 0 microversion: 2.20 time: 0.899930 Aug 24 17:36:29.560670 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 518/1101] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 24 17:36:28 2022] POST /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/action => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:36:29.569443 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:29.570172 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:29.577242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:29.577717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:29.578157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:29.578872 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:29.579356 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:29.579781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:29.619251 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:29.619875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:29.627148 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:29.627148 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:29.627671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:29.628245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:29.628737 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:29.629169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:30.046508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:30.059446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:30.061236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:30.063512 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8f702ccd-c854-4652-aab2-f10bbaf573d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.498286 Aug 24 17:36:30.064275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 584/1102] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:29 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:30.072200 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:30.074566 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:30.082313 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:30.083061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:30.083659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:30.084731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:30.085379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:30.086045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:30.096553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:30.104594 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-52f95faa-1dcf-4b42-b407-cd4c94d2243a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.489954 Aug 24 17:36:30.105182 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 519/1103] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:29 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:30.236229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:30.244788 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2d3bd030-dcbb-4a77-881f-fb89e4cd520f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.179182 Aug 24 17:36:30.245483 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 585/1104] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:30 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:31.092313 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:31.092925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:31.100619 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:31.101568 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:31.101568 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:31.102289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:31.102751 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:31.103208 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:31.125694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:31.126373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:31.133717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:31.134216 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:31.134663 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:31.135604 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:31.136078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:31.136514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:31.321784 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:31.331707 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:31.333440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:31.334560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-561da085-d809-49bb-a7a0-0ef59b328408 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.246340 Aug 24 17:36:31.335660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 520/1105] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:31 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:31.335869 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:31.341243 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:31.341720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:31.344126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-dfa909aa-2c24-4c12-b89a-5db19ca637bb tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.222689 Aug 24 17:36:31.344704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 586/1106] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:31 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:31.349116 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:31.352617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:31.352617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:31.352617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:31.352617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:31.353178 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:31.524073 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:31.532570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3283389b-0ced-44b6-9234-62e38bc87301 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.196471 Aug 24 17:36:31.533158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 521/1107] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:31 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:32.359746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:32.360433 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:32.367584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:32.368291 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:32.368889 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:32.369472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:32.369970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:32.370073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:32.370166 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:32.370454 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:32.376592 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:32.377079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:32.377513 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:32.379159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:32.379693 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:32.380217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:32.400883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:32.583188 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:32.592421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:32.594249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:32.596248 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:32.597671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3b9f6a11-f297-4f6d-8c61-4be2cdd5a367 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.241922 Aug 24 17:36:32.598700 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 587/1108] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:32 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:32.603545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:32.605118 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:32.610659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:32.611116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:32.611557 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:32.612263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:32.613261 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:32.613683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:32.616495 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8407a776-d7f2-4109-8c5b-79a61a97167b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.248770 Aug 24 17:36:32.621241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 522/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:32 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:32.637556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=100 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:32.755590 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:32.764536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3168b83e-6642-4084-a4f7-5442464691f8 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.164587 Aug 24 17:36:32.765151 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 588/1110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:32 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:33.625066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:33.625871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:33.633611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:33.634186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:33.634536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:33.635303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:33.635757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:33.636176 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:33.640197 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:33.641045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:33.649226 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:33.649861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:33.650312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:33.651139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:33.652061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:33.652492 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:33.854444 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:33.864223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:33.864979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:33.866538 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:33.867660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b13ce0cf-d76f-4d09-a83f-171ee976cb3b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.247287 Aug 24 17:36:33.868400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 523/1111] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:33 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:33.872808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-88720276-0f24-46ac-a7db-b26a287e44db tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.238786 Aug 24 17:36:33.873267 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:33.873413 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 589/1112] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:33 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:33.874162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:33.881318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:33.882038 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:33.882482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:33.883224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:33.883680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:33.884104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:34.048451 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:34.057457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c95fb196-dfea-4b8d-bf33-bfd4262de7c7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.187898 Aug 24 17:36:34.071123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 524/1113] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:33 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:34.891956 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:34.892597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:34.899830 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:34.900346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:34.900784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:34.901489 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:34.902201 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:34.902622 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:34.903494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:34.904260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:34.913104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:34.913610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:34.914064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:34.914780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:34.915278 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:34.915716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:35.111109 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:35.122206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:35.122390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-779ddb7d-bbe5-4b20-a18d-929c6479f0c7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.222464 Aug 24 17:36:35.122390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 525/1114] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:34 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:35.125295 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:35.126021 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:35.132533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:35.133031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:35.133473 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:35.134148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:35.134274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:35.134630 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:35.135105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:35.136917 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:35.138709 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-323165a1-b6c8-4cc2-9809-b5fc9cdcb38d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.250490 Aug 24 17:36:35.139334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 590/1115] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:34 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:35.285528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:35.294359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a05e0db2-a928-46bd-b8ed-a6fcfb690acd tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.172819 Aug 24 17:36:35.294973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 526/1116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:35 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:35.805581 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-5b463aa2-2187-47c1-8d47-f3e6568a9b49 req-3d150bcc-1824-4954-866c-0f56b900cece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a7e303-08e1-4970-a0c8-e30d82054b93", "name": "network-vif-plugged", "status": "completed", "tag": "2b921a7d-2dbb-4c33-a5ee-bf04279355e3"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:35.815702 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-5b463aa2-2187-47c1-8d47-f3e6568a9b49 req-3d150bcc-1824-4954-866c-0f56b900cece service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:35.816217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-5b463aa2-2187-47c1-8d47-f3e6568a9b49 req-3d150bcc-1824-4954-866c-0f56b900cece service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:35.816644 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-5b463aa2-2187-47c1-8d47-f3e6568a9b49 req-3d150bcc-1824-4954-866c-0f56b900cece service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:35.850682 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-5b463aa2-2187-47c1-8d47-f3e6568a9b49 req-3d150bcc-1824-4954-866c-0f56b900cece service nova] Creating event network-vif-plugged:2b921a7d-2dbb-4c33-a5ee-bf04279355e3 for instance 68a7e303-08e1-4970-a0c8-e30d82054b93 on hv-cinder-85164 Aug 24 17:36:35.862461 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-5b463aa2-2187-47c1-8d47-f3e6568a9b49 req-3d150bcc-1824-4954-866c-0f56b900cece service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059586 Aug 24 17:36:35.862461 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 591/1117] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:36:36.141874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:36.142467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:36.149637 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:36.150142 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:36.150826 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:36.151533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:36.152314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:36.152741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:36.163729 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:36.164446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:36.170958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:36.171466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:36.171913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:36.172620 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:36.173082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:36.173509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:36.391207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:36.400447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71985d19-28b0-457c-a0f4-137081461cf6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.262248 Aug 24 17:36:36.401941 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 527/1118] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:36 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:36.406829 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:36.407939 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:36.414883 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:36.418014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:36.418014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:36.418014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:36.418014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:36.418824 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:36.418824 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:36.424681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:36.426294 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:36.427633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-292c8544-9030-4976-9df6-8e0b8bc5f3bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.269023 Aug 24 17:36:36.428479 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 592/1119] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:36 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:36:36.636347 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:36.643758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5af107f1-f4cb-444a-b9b8-82c8681138eb tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.240479 Aug 24 17:36:36.644962 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 528/1120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:36 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:37.424761 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:37.426043 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:37.433268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:37.433756 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:37.434192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:37.434918 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:37.435391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:37.435814 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:37.465707 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:37.466595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:37.475491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:37.476314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:37.477002 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:37.478145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:37.478968 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:37.480030 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:37.666983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:37.680718 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c7630160-8157-456f-93bc-99b5f1f14429 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.259547 Aug 24 17:36:37.681942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 593/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:37 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:37.690167 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:37.691263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:37.698922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:37.699776 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:37.700281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:37.700722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:37.701794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:37.702580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:37.702692 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:37.703293 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:37.704248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:37.705453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-23296131-2332-46bb-964b-ba31a782742f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.247651 Aug 24 17:36:37.706049 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 529/1122] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:37 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:37.880901 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:37.888882 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c1d90a8e-9872-4327-b701-19367c614fbe tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.205602 Aug 24 17:36:37.889452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 594/1123] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:37 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:38.410008 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-ad883a22-e820-4822-a7bd-75b0c72edfb0 req-5f85f8d4-4711-48c6-9c0c-ece1f37d4f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d", "name": "network-vif-plugged", "status": "completed", "tag": "6ad650fb-2ab0-4c92-bbe5-467990c85e47"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:38.422948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ad883a22-e820-4822-a7bd-75b0c72edfb0 req-5f85f8d4-4711-48c6-9c0c-ece1f37d4f2d service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:38.423382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ad883a22-e820-4822-a7bd-75b0c72edfb0 req-5f85f8d4-4711-48c6-9c0c-ece1f37d4f2d service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:38.425029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-ad883a22-e820-4822-a7bd-75b0c72edfb0 req-5f85f8d4-4711-48c6-9c0c-ece1f37d4f2d service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:38.435408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-ad883a22-e820-4822-a7bd-75b0c72edfb0 req-5f85f8d4-4711-48c6-9c0c-ece1f37d4f2d service nova] Creating event network-vif-plugged:6ad650fb-2ab0-4c92-bbe5-467990c85e47 for instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d on hv-cinder-85164 Aug 24 17:36:38.441540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-ad883a22-e820-4822-a7bd-75b0c72edfb0 req-5f85f8d4-4711-48c6-9c0c-ece1f37d4f2d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224967 Aug 24 17:36:38.442158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 530/1124] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:36:38.705450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:38.706570 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:38.716519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:38.717875 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:38.717875 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:38.718227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:38.718604 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:38.719061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:38.740406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:38.741560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:38.762533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:38.762533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:38.762533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:38.762533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:38.763190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:38.763190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:38.949591 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:38.968178 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9ac1e91e-c75e-44e4-8e3c-5186054f0934 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1260 microversion: 2.1 time: 0.269318 Aug 24 17:36:38.969489 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 595/1125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:38 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:38.975342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:38.976260 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:38.984083 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:38.984769 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:38.985997 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:38.986651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:38.989088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:38.990420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:38.991131 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:38.998973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:38.998973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:38.998973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f1c84cfe-92b0-4cd1-8f20-eaf065379561 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.271921 Aug 24 17:36:39.003140 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 531/1126] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:38 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:39.170340 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:39.179885 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-034eb9f9-7710-42e6-829c-7fc762a6e117 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.209124 Aug 24 17:36:39.180475 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 596/1127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:38 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:39.997268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:39.997873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:40.004645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:40.005134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:40.005565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:40.006256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:40.006706 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:40.007151 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:40.025526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:40.026191 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:40.033834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:40.034448 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:40.035660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:40.036363 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:40.036846 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:40.037272 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:40.211446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:40.219405 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:40.219765 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a193373-8835-4427-8fda-918c0a89853b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1443 microversion: 2.1 time: 0.226302 Aug 24 17:36:40.220420 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 532/1128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:39 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1443 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:40.226039 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:40.227128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:40.229230 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:40.230768 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:40.232004 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-123721e9-5788-4c27-8203-2fa3496b4ede tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.210878 Aug 24 17:36:40.232565 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 597/1129] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:40 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:40.234625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:40.235168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:40.235610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:40.236474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:40.237115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:40.237411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:40.244408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:40.245133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:40.251820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:40.252246 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:40.252689 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:40.253528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:40.253990 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:40.254420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:40.463742 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:40.472665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f23e789c-f744-42d1-8110-981d05cdd1dc tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.251034 Aug 24 17:36:40.473555 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 533/1130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:40 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:40.476775 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:40.491112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5271bdc9-2d92-48b1-b2bb-21f75d796d1e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1443 microversion: 2.1 time: 0.250940 Aug 24 17:36:40.492236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 598/1131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:40 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1443 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:41.260527 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:41.261150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:41.269152 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:41.269652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:41.270150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:41.270799 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:41.271281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:41.272001 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:41.496838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:41.503206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:41.514939 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:41.515765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:41.516414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:41.517165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:41.517704 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:41.518141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:41.647570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:41.658466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:41.665704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:41.665704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d2b34a8-2f83-4105-87d3-acb530503528 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.405283 Aug 24 17:36:41.665704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 534/1132] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:41 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:41.807068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:41.815434 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1b622dc1-526f-4705-8482-d049612c898c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1265 microversion: 2.1 time: 0.323488 Aug 24 17:36:41.816064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 599/1133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:41 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:42.685311 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:42.685928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:42.693363 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:42.694233 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:42.695116 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:42.696396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:42.697249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:42.698044 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:42.843827 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:42.844779 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:42.853084 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:42.853730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:42.854314 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:42.855419 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:42.856119 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:42.856945 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:42.892147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:42.908179 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:42.910446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:42.911703 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c10d2f2a-645b-481f-9f91-0dc421049242 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.230559 Aug 24 17:36:42.912269 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 535/1134] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:42 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:43.147042 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5fbd9209-840e-45b4-b122-10c53f7654ac tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:43.147547 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5fbd9209-840e-45b4-b122-10c53f7654ac tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:43.154466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbd9209-840e-45b4-b122-10c53f7654ac tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:43.155063 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbd9209-840e-45b4-b122-10c53f7654ac tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:43.155510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbd9209-840e-45b4-b122-10c53f7654ac tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:43.156231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbd9209-840e-45b4-b122-10c53f7654ac tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:43.156688 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbd9209-840e-45b4-b122-10c53f7654ac tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:43.157115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5fbd9209-840e-45b4-b122-10c53f7654ac tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:43.183447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5fbd9209-840e-45b4-b122-10c53f7654ac tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/ips" status: 200 len: 148 microversion: 2.1 time: 0.239699 Aug 24 17:36:43.184257 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 536/1135] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:36:42 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/ips => generated 148 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:36:43.407349 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:43.417874 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9f0cd919-a42d-4718-9ee6-b5e7db43b1e7 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1451 microversion: 2.1 time: 0.580272 Aug 24 17:36:43.418451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 600/1136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:42 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1451 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:36:43.438157 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:43.438777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:43.445455 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:43.455415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:43.455415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:43.455415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:43.455415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:43.455873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:43.695873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:43.705537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7b4956a8-7989-4a03-8e3e-f47210a30789 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1451 microversion: 2.1 time: 0.271176 Aug 24 17:36:43.706122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 537/1137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:36:43 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1451 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:36:43.719198 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-8d8a6c17-b438-4f71-80dd-d35e1299cfb4 req-ccc81cd7-42aa-4f15-8928-277581393c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a7e303-08e1-4970-a0c8-e30d82054b93", "tag": "2b921a7d-2dbb-4c33-a5ee-bf04279355e3"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:43.729267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-8d8a6c17-b438-4f71-80dd-d35e1299cfb4 req-ccc81cd7-42aa-4f15-8928-277581393c8d service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:43.729946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-8d8a6c17-b438-4f71-80dd-d35e1299cfb4 req-ccc81cd7-42aa-4f15-8928-277581393c8d service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:43.730661 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-8d8a6c17-b438-4f71-80dd-d35e1299cfb4 req-ccc81cd7-42aa-4f15-8928-277581393c8d service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:43.748230 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-8d8a6c17-b438-4f71-80dd-d35e1299cfb4 req-ccc81cd7-42aa-4f15-8928-277581393c8d service nova] Creating event network-changed:2b921a7d-2dbb-4c33-a5ee-bf04279355e3 for instance 68a7e303-08e1-4970-a0c8-e30d82054b93 on hv-cinder-85164 Aug 24 17:36:43.754809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-8d8a6c17-b438-4f71-80dd-d35e1299cfb4 req-ccc81cd7-42aa-4f15-8928-277581393c8d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165540 Aug 24 17:36:43.755586 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 601/1138] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:36:43.945482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:43.946173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:43.969080 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:43.969977 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:43.974552 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:43.981199 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:43.982787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:43.983895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:44.332836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:44.362415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:44.366429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:44.367938 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a07cab5b-2172-42f7-b98f-79400035ab62 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1745 microversion: 2.20 time: 0.434550 Aug 24 17:36:44.368847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 538/1139] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:43 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1745 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:45.401486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:45.404161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:45.412182 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:45.418597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:45.420002 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:45.421104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:45.422640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:45.423738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:45.424798 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:45.609556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:45.620750 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:45.623809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:45.623809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-faa946aa-78c8-46ee-97e0-6908babff0d9 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1745 microversion: 2.20 time: 0.232774 Aug 24 17:36:45.624588 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 602/1140] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:45 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1745 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:46.141111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-77c40e7d-37fc-4c78-85b9-e03b82b1a521 req-65a4f8bf-c740-4198-ae31-a4515c7186ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127fd694-1843-4ba5-97aa-2565c01c30c2", "name": "network-vif-plugged", "status": "completed", "tag": "dc1417c8-efa2-4bc9-882a-0f8de0684957"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:46.147446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:46.154078 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-77c40e7d-37fc-4c78-85b9-e03b82b1a521 req-65a4f8bf-c740-4198-ae31-a4515c7186ab service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:46.154878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-77c40e7d-37fc-4c78-85b9-e03b82b1a521 req-65a4f8bf-c740-4198-ae31-a4515c7186ab service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:46.156116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dc936342-e5e3-4d47-98e1-5052d73e771b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e64e7047-7206-4eea-b27f-90a69e5514c4"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:46.156524 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-77c40e7d-37fc-4c78-85b9-e03b82b1a521 req-65a4f8bf-c740-4198-ae31-a4515c7186ab service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:46.161760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-dc936342-e5e3-4d47-98e1-5052d73e771b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:46.174715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-77c40e7d-37fc-4c78-85b9-e03b82b1a521 req-65a4f8bf-c740-4198-ae31-a4515c7186ab service nova] Creating event network-vif-plugged:dc1417c8-efa2-4bc9-882a-0f8de0684957 for instance 127fd694-1843-4ba5-97aa-2565c01c30c2 on hv-cinder-85164 Aug 24 17:36:46.175273 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc936342-e5e3-4d47-98e1-5052d73e771b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:46.175774 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc936342-e5e3-4d47-98e1-5052d73e771b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:46.176288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc936342-e5e3-4d47-98e1-5052d73e771b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:46.176964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc936342-e5e3-4d47-98e1-5052d73e771b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:46.177529 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc936342-e5e3-4d47-98e1-5052d73e771b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:46.177960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dc936342-e5e3-4d47-98e1-5052d73e771b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:46.181259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-77c40e7d-37fc-4c78-85b9-e03b82b1a521 req-65a4f8bf-c740-4198-ae31-a4515c7186ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043916 Aug 24 17:36:46.182088 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 539/1141] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:36:46.650460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:46.651718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:46.661579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:46.663121 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:46.663765 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:46.664776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:46.665568 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:46.667495 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:46.912749 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:46.916389 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:46.921878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:46.923342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:46.924525 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6d837262-bf30-4f9e-bfce-71a8889b24b8 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1745 microversion: 2.20 time: 0.280922 Aug 24 17:36:46.925350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 540/1142] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:46 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1745 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:36:46.935173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-078543dd-a4a1-48a2-8240-de6282d1ddcd req-2dd75d8f-0ead-45ca-ad09-83139bc220e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d", "tag": "6ad650fb-2ab0-4c92-bbe5-467990c85e47"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:46.946093 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-078543dd-a4a1-48a2-8240-de6282d1ddcd req-2dd75d8f-0ead-45ca-ad09-83139bc220e7 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:46.946559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-078543dd-a4a1-48a2-8240-de6282d1ddcd req-2dd75d8f-0ead-45ca-ad09-83139bc220e7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:46.947000 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-078543dd-a4a1-48a2-8240-de6282d1ddcd req-2dd75d8f-0ead-45ca-ad09-83139bc220e7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:46.960140 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-078543dd-a4a1-48a2-8240-de6282d1ddcd req-2dd75d8f-0ead-45ca-ad09-83139bc220e7 service nova] Creating event network-changed:6ad650fb-2ab0-4c92-bbe5-467990c85e47 for instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d on hv-cinder-85164 Aug 24 17:36:46.965432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-078543dd-a4a1-48a2-8240-de6282d1ddcd req-2dd75d8f-0ead-45ca-ad09-83139bc220e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038768 Aug 24 17:36:46.966088 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 541/1143] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:36:47.951762 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:47.952623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:47.960018 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:47.960690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:47.960971 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:47.961683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:47.962143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:47.962566 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:48.002575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-dc936342-e5e3-4d47-98e1-5052d73e771b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.854940 Aug 24 17:36:48.010439 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 603/1144] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:36:46 2022] POST /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments => generated 194 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:36:48.148664 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:48.167374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:48.169837 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:48.171372 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-bbf5b4b9-8ca2-4ef6-a8bd-350217c4b96a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1745 microversion: 2.20 time: 0.224870 Aug 24 17:36:48.172134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 542/1145] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:47 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1745 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:36:49.213721 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:49.214452 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:49.221946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:49.222441 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:49.222883 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:49.223644 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:49.224340 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:49.225037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:49.387471 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:49.398430 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:49.401117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:49.402585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c6b8fdf0-f4a4-48f5-98ec-b2243a33e5c0 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1745 microversion: 2.20 time: 0.193826 Aug 24 17:36:49.403259 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 604/1146] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:49 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:36:50.425816 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:50.426345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:50.433214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:50.433700 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:50.434138 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:50.434845 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:50.435302 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:50.442883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:50.571670 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:50.580154 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:50.581721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:50.582908 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5e65114f-dace-4728-87e9-dd97a1091f26 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1745 microversion: 2.20 time: 0.161113 Aug 24 17:36:50.583495 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 543/1147] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:50 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:51.606137 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:51.607056 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:51.613660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:51.614212 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:51.614651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:51.615371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:51.615820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:51.616340 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:51.634879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:36:51.763203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:51.772696 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:51.774249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:51.775470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bded4c33-adbb-48fb-aa74-0ed779d0b876 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.173276 Aug 24 17:36:51.776016 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 605/1148] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:51 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:36:52.805250 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:52.806338 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:52.826613 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:52.827638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:52.828248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:52.829448 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:52.830432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:52.831476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:53.054498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:53.068724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:53.070484 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:53.071794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cb177d10-d49d-4ade-a894-3002c1caee76 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.275506 Aug 24 17:36:53.082956 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 544/1149] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:52 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:54.118568 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:54.120233 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:54.129329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:54.134543 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:54.134543 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:54.134543 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:54.134543 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:54.135291 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:54.344845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:54.361360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:54.366669 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:54.373810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e5075834-329e-4699-a703-c9ad81b8a695 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.262298 Aug 24 17:36:54.381834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 606/1150] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:54 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:55.413716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:55.414341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:55.421461 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:55.422098 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:55.422406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:55.423186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:55.423655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:55.424085 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:55.657449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:55.667168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:55.668793 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:55.670112 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2cd3f25b-452c-4929-9768-ac684e72d373 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.260353 Aug 24 17:36:55.670858 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 545/1151] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:55 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:56.696712 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:56.698660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:56.715675 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:56.718850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:56.718850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:56.718850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:56.718850 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:56.719783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:56.946853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:56.963296 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:56.967124 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:56.970949 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f30cf9e2-45a1-49c2-be95-af2be40f8fde tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.277392 Aug 24 17:36:56.975485 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 607/1152] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:56 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:57.967462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e64e7047-7206-4eea-b27f-90a69e5514c4"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:36:57.972097 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:57.986156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:57.987570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:57.988573 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:57.990019 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:57.990814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:57.991564 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:58.011937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:58.014069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:58.028215 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:58.029532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:58.031144 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:58.032960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:58.034077 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:58.035168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:58.145390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Invalid volume: volume e64e7047-7206-4eea-b27f-90a69e5514c4 is already attached to instances: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: POST /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments HTTP/1.1 Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 74 Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:36:58.153731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {"volumeAttachment": {"volumeId": "e64e7047-7206-4eea-b27f-90a69e5514c4"}} Aug 24 17:36:58.156334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Invalid volume: volume e64e7047-7206-4eea-b27f-90a69e5514c4 is already attached to instances: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'server_id': 'e9f9ac6a-3c93-4196-826d-9e1f7adb52bf', 'body': {'volumeAttachment': {'volumeId': 'e64e7047-7206-4eea-b27f-90a69e5514c4'}}} Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e64e7047-7206-4eea-b27f-90a69e5514c4 is already attached to instances: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:36:58.157292 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e64e7047-7206-4eea-b27f-90a69e5514c4 is already attached to instances: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:36:58.158627 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:36:58.160370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:36:58.160370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:36:58.160370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:36:58.160370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e64e7047-7206-4eea-b27f-90a69e5514c4 is already attached to instances: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf Aug 24 17:36:58.160370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:36:58.160370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 400 to user: Invalid volume: volume e64e7047-7206-4eea-b27f-90a69e5514c4 is already attached to instances: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:36:58.160370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-77553485-43a8-4d71-9c90-e4e0b6fec71d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.196037 Aug 24 17:36:58.173655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 546/1153] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:36:57 2022] POST /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments => generated 174 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:36:58.289575 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:58.292723 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:58.320817 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:58.328730 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:58.329773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:58.332699 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:58.333433 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:58.334079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:58.388993 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:58.402358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:58.405505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:58.407045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6d2613e2-97b9-49da-9a96-86309c3798ed tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.402500 Aug 24 17:36:58.408277 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 608/1154] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:58 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:58.525419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lazy-loading 'services' on Instance uuid e9f9ac6a-3c93-4196-826d-9e1f7adb52bf {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:36:58.766950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-348be0bf-b666-40e7-9cf8-2894fbba5d6f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments/e64e7047-7206-4eea-b27f-90a69e5514c4" status: 202 len: 0 microversion: 2.1 time: 0.489307 Aug 24 17:36:58.768259 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 547/1155] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:36:58 2022] DELETE /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments/e64e7047-7206-4eea-b27f-90a69e5514c4 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:36:58.778857 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e2b74bb9-c44e-4354-84fd-48c10905796c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:58.781248 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e2b74bb9-c44e-4354-84fd-48c10905796c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:58.791273 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2b74bb9-c44e-4354-84fd-48c10905796c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:58.792191 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2b74bb9-c44e-4354-84fd-48c10905796c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:58.792983 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2b74bb9-c44e-4354-84fd-48c10905796c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:58.794504 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2b74bb9-c44e-4354-84fd-48c10905796c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:58.795879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2b74bb9-c44e-4354-84fd-48c10905796c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:58.797173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e2b74bb9-c44e-4354-84fd-48c10905796c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:58.857556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e2b74bb9-c44e-4354-84fd-48c10905796c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084066 Aug 24 17:36:58.858514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 609/1156] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:36:58 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:36:59.449283 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:59.451490 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:59.463104 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:59.464340 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:59.465311 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:59.466498 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:59.467462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:59.468012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:59.705839 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:59.724364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:59.725916 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:36:59.727866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f82c79db-4f79-4ec9-844b-1151d51f8066 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.287525 Aug 24 17:36:59.728686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 548/1157] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:36:59 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:36:59.873416 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4f048996-775c-413a-a224-ce90e9a5b627 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:36:59.879098 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4f048996-775c-413a-a224-ce90e9a5b627 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:36:59.884929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f048996-775c-413a-a224-ce90e9a5b627 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:59.885429 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f048996-775c-413a-a224-ce90e9a5b627 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:59.885873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f048996-775c-413a-a224-ce90e9a5b627 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:59.886605 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f048996-775c-413a-a224-ce90e9a5b627 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:36:59.887115 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f048996-775c-413a-a224-ce90e9a5b627 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:36:59.887594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f048996-775c-413a-a224-ce90e9a5b627 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:36:59.930802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4f048996-775c-413a-a224-ce90e9a5b627 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062126 Aug 24 17:36:59.932328 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 610/1158] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:36:59 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:00.761643 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:00.763617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:00.774631 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:00.775938 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:00.776898 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:00.778233 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:00.778955 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:00.779861 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:00.952228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1b1fbefe-684b-4837-831d-5fafd636f983 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:00.962621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1b1fbefe-684b-4837-831d-5fafd636f983 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:00.984422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b1fbefe-684b-4837-831d-5fafd636f983 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:00.985140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b1fbefe-684b-4837-831d-5fafd636f983 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:00.987324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b1fbefe-684b-4837-831d-5fafd636f983 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:00.987324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b1fbefe-684b-4837-831d-5fafd636f983 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:00.987643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b1fbefe-684b-4837-831d-5fafd636f983 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:00.988532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1b1fbefe-684b-4837-831d-5fafd636f983 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:01.026445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:01.056483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:01.058389 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:01.059857 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8dd5fc9a-b5e1-4a9c-b6dd-c83b936522a1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.306976 Aug 24 17:37:01.078261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 549/1159] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:00 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:01.095400 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1b1fbefe-684b-4837-831d-5fafd636f983 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150201 Aug 24 17:37:01.097121 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 611/1160] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:37:00 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:02.092423 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:02.093619 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:02.103645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:02.106618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:02.106618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:02.106618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:02.106618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:02.107055 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:02.117634 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-aa10e960-f75a-434f-9489-8b12814ab412 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:02.122643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-aa10e960-f75a-434f-9489-8b12814ab412 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:02.134005 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa10e960-f75a-434f-9489-8b12814ab412 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:02.135161 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa10e960-f75a-434f-9489-8b12814ab412 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:02.136009 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa10e960-f75a-434f-9489-8b12814ab412 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:02.137501 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa10e960-f75a-434f-9489-8b12814ab412 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:02.138206 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa10e960-f75a-434f-9489-8b12814ab412 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:02.138809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa10e960-f75a-434f-9489-8b12814ab412 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:02.187170 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-aa10e960-f75a-434f-9489-8b12814ab412 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076676 Aug 24 17:37:02.188658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 612/1161] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:37:02 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:37:02.329480 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:02.330027 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:02.337388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:02.337934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:02.338375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:02.340320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:02.340798 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:02.341231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:02.362355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:02.374093 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:02.376054 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:02.376591 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:37:02.378247 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b60e90c9-299d-45bf-84ea-1673e977fbf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.295572 Aug 24 17:37:02.381374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 550/1162] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:02 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:02.757406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c88ca0d8-ceb1-476a-bcb4-b891534b65c8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 204 len: 0 microversion: 2.1 time: 0.439809 Aug 24 17:37:02.767998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 613/1163] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:37:02 2022] DELETE /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:37:02.771537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:02.772559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:02.783776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:02.784857 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:02.785309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:02.786055 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:02.786538 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:02.786995 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:03.050129 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:03.061295 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d2eba9a6-02d4-4a13-90f6-c5b7d56a1fa8 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1679 microversion: 2.1 time: 0.294669 Aug 24 17:37:03.062492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 551/1164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:02 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1679 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:03.410848 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:03.411747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:03.422318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:03.423834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:03.423834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:03.424157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:03.425809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:03.426840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:03.678755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:03.695034 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:03.697551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:03.699508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0174aad3-d757-40c7-9469-c6d24dc206c6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.295746 Aug 24 17:37:03.700318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 614/1165] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:03 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:04.093030 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:04.094185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:04.103007 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:04.110455 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:04.110455 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:04.110455 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:04.110455 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:04.111061 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:04.321321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:04.329999 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-71790532-9560-4e00-8cc4-d3d88c230f59 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1679 microversion: 2.1 time: 0.243638 Aug 24 17:37:04.330593 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 552/1166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:04 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:04.751575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:04.751575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:04.755913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:04.756408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:04.756873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:04.757963 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:04.758458 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:04.758936 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:04.915573 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:04.925668 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:04.931145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:04.931145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c7a4366d-d88d-4ece-bf90-215402351534 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.185859 Aug 24 17:37:04.931145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 615/1167] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:04 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:05.367156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:05.372588 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:05.402641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:05.403311 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:05.403764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:05.404499 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:05.405203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:05.405535 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:05.699930 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:05.712887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b1abee4e-e6e4-4697-8351-299002152d92 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1679 microversion: 2.1 time: 0.362607 Aug 24 17:37:05.722834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 553/1168] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:05 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1679 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:05.957433 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:05.958047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:05.965247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:05.965892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:05.966845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:05.968684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:05.968684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:05.969378 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:06.218032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:06.227724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:06.229621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:06.230998 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-94ad05ee-acce-4d82-ba6c-b55b4d6a0bd3 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.277714 Aug 24 17:37:06.231884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 616/1169] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:05 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:06.741444 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:06.742241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:06.751747 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:06.752701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:06.754054 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:06.755231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:06.756058 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:06.756803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:06.851622 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:06.866398 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ab8d80ef-4d3e-49cb-98d0-50e8426ec0d2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1611 microversion: 2.1 time: 0.131329 Aug 24 17:37:06.867913 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 554/1170] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:06 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1611 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:07.213923 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-9105dd83-791f-492e-96dc-98b2c7b451d4 req-a939a711-2230-4328-a83f-79e6bb05568e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f9ac6a-3c93-4196-826d-9e1f7adb52bf", "name": "network-vif-deleted", "tag": "f505ca09-8aa8-4a23-9e76-9bf9392fdff8"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:07.228929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-9105dd83-791f-492e-96dc-98b2c7b451d4 req-a939a711-2230-4328-a83f-79e6bb05568e service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:07.229580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-9105dd83-791f-492e-96dc-98b2c7b451d4 req-a939a711-2230-4328-a83f-79e6bb05568e service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:07.230126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-9105dd83-791f-492e-96dc-98b2c7b451d4 req-a939a711-2230-4328-a83f-79e6bb05568e service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:07.247315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-9105dd83-791f-492e-96dc-98b2c7b451d4 req-a939a711-2230-4328-a83f-79e6bb05568e service nova] Creating event network-vif-deleted:f505ca09-8aa8-4a23-9e76-9bf9392fdff8 for instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf on hv-cinder-85164 Aug 24 17:37:07.257410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:07.259026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:07.273440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-9105dd83-791f-492e-96dc-98b2c7b451d4 req-a939a711-2230-4328-a83f-79e6bb05568e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065629 Aug 24 17:37:07.276152 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:07.280981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:07.280981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:07.281539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 617/1171] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:07.281638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:07.281638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:07.281638 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:07.502419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:07.513786 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:07.515333 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:07.516767 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-208f139a-57d4-4ed9-93a7-7b1972ab0833 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1740 microversion: 2.20 time: 0.266662 Aug 24 17:37:07.517335 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 555/1172] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:07 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:07.903727 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:07.903727 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:07.911548 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:07.912041 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:07.912688 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:07.913691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:07.914617 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:07.915338 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:07.953550 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:07.954279 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:07.954886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:07.955534 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lazy-loading 'fault' on Instance uuid e9f9ac6a-3c93-4196-826d-9e1f7adb52bf {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:37:08.012965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:08.022778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0e35cb19-a577-4d46-bf7f-567996904902 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1330 microversion: 2.1 time: 0.131295 Aug 24 17:37:08.023408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 618/1173] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:07 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1330 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:08.545486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:08.547230 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:08.563879 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:08.564377 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:08.564823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:08.566081 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:08.566541 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:08.566992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:08.773109 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:08.782825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:08.789985 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:08.791653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5bb22879-50cb-462a-899f-2e2e613d1515 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1722 microversion: 2.20 time: 0.254560 Aug 24 17:37:08.792538 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 556/1174] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:08 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:09.054979 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:09.057155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:09.067569 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:09.068418 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:09.069592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:09.070492 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:09.071365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:09.071938 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:09.126951 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:09.127872 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:09.128637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:09.129318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lazy-loading 'fault' on Instance uuid e9f9ac6a-3c93-4196-826d-9e1f7adb52bf {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:37:09.211469 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:09.228120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-af12f729-0513-49a2-9661-d11e1ea821a9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 200 len: 1330 microversion: 2.1 time: 0.179751 Aug 24 17:37:09.229234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 619/1175] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:09 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 1330 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:09.833129 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:09.833939 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:09.841193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:09.841691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:09.842235 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:09.843250 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:09.843978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:09.844802 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:09.878592 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:10.039545 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:10.050438 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:10.052063 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:10.053267 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-740d8fdf-74ef-489e-948a-e88473a6f491 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1722 microversion: 2.20 time: 0.226381 Aug 24 17:37:10.053872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 557/1176] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:09 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:10.253541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:10.255462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:10.264743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:10.265810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:10.266533 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:10.267615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:10.268164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:10.268758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:10.275699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:10.286664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf HTTP/1.1 Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:37:10.288505 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:37:10.290221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': 'e9f9ac6a-3c93-4196-826d-9e1f7adb52bf'} Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:37:10.291508 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:37:10.292890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:37:10.294153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:37:10.294153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d007a5c7-03f3-4986-9ef2-49c55b233071 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 404 len: 111 microversion: 2.1 time: 0.042291 Aug 24 17:37:10.294153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 620/1177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:10 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:37:10.303544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c6040ff8-b22b-46d1-8e3c-9ce787aeaa1a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '.version_select at 0x7f3f30161160>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:10.311804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6040ff8-b22b-46d1-8e3c-9ce787aeaa1a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [daf562fa-ccca-4003-a680-b6f23765f664] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 17:37:10.389373 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-225d9d69-8fe2-4b89-96aa-23b0ece32b55 req-5621e25e-3f37-4e58-88ce-82cd961b33c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127fd694-1843-4ba5-97aa-2565c01c30c2", "name": "network-vif-unplugged", "status": "completed", "tag": "dc1417c8-efa2-4bc9-882a-0f8de0684957"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:10.412560 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-225d9d69-8fe2-4b89-96aa-23b0ece32b55 req-5621e25e-3f37-4e58-88ce-82cd961b33c4 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:10.412560 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-225d9d69-8fe2-4b89-96aa-23b0ece32b55 req-5621e25e-3f37-4e58-88ce-82cd961b33c4 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:10.412560 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-225d9d69-8fe2-4b89-96aa-23b0ece32b55 req-5621e25e-3f37-4e58-88ce-82cd961b33c4 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:10.426087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-225d9d69-8fe2-4b89-96aa-23b0ece32b55 req-5621e25e-3f37-4e58-88ce-82cd961b33c4 service nova] Creating event network-vif-unplugged:dc1417c8-efa2-4bc9-882a-0f8de0684957 for instance 127fd694-1843-4ba5-97aa-2565c01c30c2 on hv-cinder-85164 Aug 24 17:37:10.431386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-225d9d69-8fe2-4b89-96aa-23b0ece32b55 req-5621e25e-3f37-4e58-88ce-82cd961b33c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055861 Aug 24 17:37:10.432008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 621/1178] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:11.078456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:11.079245 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:11.087254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:11.087765 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:11.088186 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:11.088883 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:11.089337 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:11.089754 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:11.311583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:11.324123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6040ff8-b22b-46d1-8e3c-9ce787aeaa1a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [daf562fa-ccca-4003-a680-b6f23765f664] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 46420. Aug 24 17:37:11.331564 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:11.335096 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:11.337713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8ec7d54a-5e05-4bbd-81d7-5180bef7b789 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1722 microversion: 2.20 time: 0.263316 Aug 24 17:37:11.338730 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 622/1179] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:11 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:11.416256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c6040ff8-b22b-46d1-8e3c-9ce787aeaa1a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198961703" status: 202 len: 0 microversion: 2.1 time: 1.120169 Aug 24 17:37:11.417175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 558/1180] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 24 17:37:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198961703 => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:37:12.372662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:12.375532 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:12.385189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-73ae692e-ec1d-4220-af9d-181d7d96574e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: .version_select at 0x7f3f23f6e820>, body: {"keypair": {"name": "tempest-keypair-1930901264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRF5DSbYL3u/dPsFVsTq2KN4Kxi38efrQkHBsMa+YckNsJ301nEW9GwBWJOWgKWEf2UQJMjPAdbZuuc9By/9jRxXTUlYNZb/mIUfYskhJvjCVnPMhwbTvuqAOZHYfvR5w=="}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:12.405222 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:12.406894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:12.406894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:12.408288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:12.409051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:12.409738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:12.419128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-73ae692e-ec1d-4220-af9d-181d7d96574e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:37:12.426218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-73ae692e-ec1d-4220-af9d-181d7d96574e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for user 160ce86c89ea449da346d98d20ce2a9e and project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'key_pairs'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:37:12.568289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-73ae692e-ec1d-4220-af9d-181d7d96574e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190237 Aug 24 17:37:12.575335 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 559/1181] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Aug 24 17:37:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:12.593184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:12.609714 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:12.613134 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:12.614980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1aa6f73f-ccd3-405a-8b24-4c2c02d18e97 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1722 microversion: 2.20 time: 0.249459 Aug 24 17:37:12.615941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 623/1182] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:12 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:13.640571 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:13.642607 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:13.649162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:13.649994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:13.650432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:13.651228 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:13.651796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:13.652495 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:13.827187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:13.836533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:13.838051 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:13.839388 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a1902c8-7c27-4839-9881-1195340ac991 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1665 microversion: 2.20 time: 0.202898 Aug 24 17:37:13.839954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 560/1183] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:13 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1665 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:13.867218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-faf70e1f-8b4a-490f-843a-e5088b77bb52 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5239d6e-48c5-4f4e-a4bd-af4897f1b94a"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:13.870539 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-faf70e1f-8b4a-490f-843a-e5088b77bb52 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:13.879766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf70e1f-8b4a-490f-843a-e5088b77bb52 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:13.879766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf70e1f-8b4a-490f-843a-e5088b77bb52 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:13.879766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf70e1f-8b4a-490f-843a-e5088b77bb52 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:13.880380 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf70e1f-8b4a-490f-843a-e5088b77bb52 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:13.880862 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf70e1f-8b4a-490f-843a-e5088b77bb52 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:13.881283 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-faf70e1f-8b4a-490f-843a-e5088b77bb52 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:15.059242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-faf70e1f-8b4a-490f-843a-e5088b77bb52 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.196882 Aug 24 17:37:15.068861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 624/1184] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Aug 24 17:37:13 2022] POST /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/os-volume_attachments => generated 188 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:37:15.214306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b48126c0-7f88-4507-b40f-cf1a9bce5bce tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:15.214990 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b48126c0-7f88-4507-b40f-cf1a9bce5bce tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:15.223991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b48126c0-7f88-4507-b40f-cf1a9bce5bce tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:15.224958 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b48126c0-7f88-4507-b40f-cf1a9bce5bce tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:15.225580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b48126c0-7f88-4507-b40f-cf1a9bce5bce tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:15.226486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b48126c0-7f88-4507-b40f-cf1a9bce5bce tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:15.226972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b48126c0-7f88-4507-b40f-cf1a9bce5bce tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:15.227574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b48126c0-7f88-4507-b40f-cf1a9bce5bce tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:15.309495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1322281937", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9785c9b4-9808-422c-887b-d51293243d04"}], "security_groups": [{"name": "tempest-securitygroup--924436227"}], "key_name": "tempest-keypair-1930901264", "user_data": "}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:15.438393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.network.neutron [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] validate_networks() for [('9785c9b4-9808-422c-887b-d51293243d04', None, None, None, None, None)] {{(pid=121011) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:37:15.943779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b48126c0-7f88-4507-b40f-cf1a9bce5bce tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/os-volume_attachments/c5239d6e-48c5-4f4e-a4bd-af4897f1b94a" status: 202 len: 0 microversion: 2.20 time: 0.733339 Aug 24 17:37:15.944435 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 561/1185] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Aug 24 17:37:15 2022] DELETE /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/os-volume_attachments/c5239d6e-48c5-4f4e-a4bd-af4897f1b94a => generated 0 bytes in 735 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:37:15.953344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Flavor limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:37:15.953344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Image limits 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:37:15.953808 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Flavor pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:37:15.954236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Image pref 0:0:0 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:37:15.954618 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.virt.hardware [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121011) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:37:15.964596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:15.965090 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:15.965517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:15.966242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:15.966725 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:15.967205 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:15.986263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:37:15.991912 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.quota [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Getting quotas for user 160ce86c89ea449da346d98d20ce2a9e and project f6ebea743b3843f3b6274ddfc0b5b73a. Resources: {'cores', 'instances', 'ram'} {{(pid=121011) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:37:16.008863 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Going to run 1 instances... {{(pid=121011) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:37:16.009883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:16.010486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:16.011547 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121011) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:37:16.017744 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:16.019098 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:16.019282 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:16.019997 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:16.020461 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:16.020889 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:16.078763 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121010) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:37:16.206131 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-49e1a03f-1fb7-4755-8276-5eaf4bd2b2d1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.903034 Aug 24 17:37:16.206854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 625/1186] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:37:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:37:16.219228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-07ce0591-3120-421c-acf3-0347caa5112a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:16.220507 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-07ce0591-3120-421c-acf3-0347caa5112a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:16.222614 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:16.304272 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-07ce0591-3120-421c-acf3-0347caa5112a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:16.311824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-07ce0591-3120-421c-acf3-0347caa5112a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1242 microversion: 2.1 time: 0.097852 Aug 24 17:37:16.312417 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 626/1187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:16 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:16.444228 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-57d8d685-eb1f-4112-b6d3-0f428ed2eaf1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "POST /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/action" status: 202 len: 0 microversion: 2.20 time: 0.438555 Aug 24 17:37:16.445821 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 562/1188] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Aug 24 17:37:16 2022] POST /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:37:16.454382 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:16.455376 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:16.464195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:16.464831 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:16.465210 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:16.466007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:16.466526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:16.467026 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:16.618862 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:16.627159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:16.628740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:16.629920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5e3d25be-1904-4673-9d2a-e32c51bf9d42 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1673 microversion: 2.20 time: 0.180796 Aug 24 17:37:16.630484 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 627/1189] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:16 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:17.339423 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b23563a-d531-42df-b43c-67af7202c919 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:17.340580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b23563a-d531-42df-b43c-67af7202c919 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:17.421096 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9b23563a-d531-42df-b43c-67af7202c919 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:17.432557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b23563a-d531-42df-b43c-67af7202c919 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1242 microversion: 2.1 time: 0.101325 Aug 24 17:37:17.443466 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 563/1190] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:17 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:17.656607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:17.662265 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:17.672868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:17.673511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:17.674183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:17.675830 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:17.676694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:17.677178 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:18.145698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:18.155402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:18.157035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:18.158651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-6f00ea99-66a6-48de-82c8-8203b4e075d1 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1673 microversion: 2.20 time: 0.508644 Aug 24 17:37:18.160112 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 628/1191] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:17 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1673 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:18.466866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:18.467519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:18.469469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:18.474399 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:18.474891 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:18.476957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:18.476957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:18.476957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:18.476957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:18.545158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:18.555505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aeaf3e58-1cec-44db-95a0-348e7426d64c tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1294 microversion: 2.1 time: 0.094675 Aug 24 17:37:18.556317 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 564/1192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:18 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:19.187707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:19.188939 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:19.198122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:19.199015 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:19.199923 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:19.202985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:19.202985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:19.202985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:19.358149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:19.368868 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:19.370405 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:19.371724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-622cbd00-071f-46c1-8657-63e836bb6f4a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.188172 Aug 24 17:37:19.372293 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 629/1193] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:19 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:19.579622 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:19.580255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:19.591065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:19.591655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:19.592111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:19.592830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:19.593430 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:19.593817 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:19.666807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:19.675877 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4ccd6b75-9479-43e8-bd35-5f1e7bd4eb47 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1312 microversion: 2.1 time: 0.099922 Aug 24 17:37:19.676784 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 565/1194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:19 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:20.397049 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:20.397660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:20.404578 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:20.405072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:20.405507 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:20.406391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:20.407033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:20.407621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:20.570018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:20.591490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:20.594601 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:20.596746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-57268744-d3f5-4067-a382-bc449045d34a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.204164 Aug 24 17:37:20.598298 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 630/1195] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:20 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:20.699060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:20.700173 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:20.729093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:20.729093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:20.729093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:20.729093 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:20.729465 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:20.729465 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:20.934031 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:20.942516 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9fd566ed-747f-4520-bae3-9bb06e013021 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.248945 Aug 24 17:37:20.943113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 631/1196] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:20 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:20.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e0639ac4-a266-4c52-b9ed-98137d94e628 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:20.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e0639ac4-a266-4c52-b9ed-98137d94e628 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:20.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0639ac4-a266-4c52-b9ed-98137d94e628 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:20.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0639ac4-a266-4c52-b9ed-98137d94e628 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:20.973503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0639ac4-a266-4c52-b9ed-98137d94e628 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:20.973708 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0639ac4-a266-4c52-b9ed-98137d94e628 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:20.974219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0639ac4-a266-4c52-b9ed-98137d94e628 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:20.974648 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e0639ac4-a266-4c52-b9ed-98137d94e628 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:21.010357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e0639ac4-a266-4c52-b9ed-98137d94e628 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/ips" status: 200 len: 145 microversion: 2.1 time: 0.376972 Aug 24 17:37:21.011802 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 566/1197] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:37:20 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/ips => generated 145 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:21.633435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:21.634657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:21.656427 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:21.657234 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:21.657342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:21.658047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:21.660042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:21.660696 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:21.774075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1594036e-fdb0-4a2e-a553-64c3a153ad5c req-1c92af6d-8a20-46da-8f09-e62b2b9a3633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b", "tag": "54ee51a3-c6d8-4bba-ade2-885300b52ffb"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:21.794787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1594036e-fdb0-4a2e-a553-64c3a153ad5c req-1c92af6d-8a20-46da-8f09-e62b2b9a3633 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:21.795584 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1594036e-fdb0-4a2e-a553-64c3a153ad5c req-1c92af6d-8a20-46da-8f09-e62b2b9a3633 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:21.796338 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1594036e-fdb0-4a2e-a553-64c3a153ad5c req-1c92af6d-8a20-46da-8f09-e62b2b9a3633 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:21.847123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1594036e-fdb0-4a2e-a553-64c3a153ad5c req-1c92af6d-8a20-46da-8f09-e62b2b9a3633 service nova] Creating event network-changed:54ee51a3-c6d8-4bba-ade2-885300b52ffb for instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b on hv-cinder-85164 Aug 24 17:37:21.856438 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1594036e-fdb0-4a2e-a553-64c3a153ad5c req-1c92af6d-8a20-46da-8f09-e62b2b9a3633 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093412 Aug 24 17:37:21.857673 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 567/1198] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:37:21.945073 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:21.966351 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:21.967128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:21.975793 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:21.982019 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:21.983807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:21.985551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:21.987134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:21.987388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c5192d1e-ee0c-48bd-ad87-71473db9bae7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.359719 Aug 24 17:37:22.000647 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:22.000876 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:22.001236 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:22.007791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 632/1199] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:21 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:22.244764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:22.261831 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2eca875a-80af-4789-91c1-6948804f46ba tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.299151 Aug 24 17:37:22.263071 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 568/1200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:21 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:23.015219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:23.015958 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:23.024758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:23.025383 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:23.026066 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:23.026801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:23.027626 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:23.028072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:23.182321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:23.192028 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:23.193464 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:23.194627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fe0be5cf-7843-41f4-9147-f712b762c36d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.183395 Aug 24 17:37:23.195226 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 633/1201] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:23 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:23.287983 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:23.288819 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:23.296884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:23.297371 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:23.297855 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:23.299032 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:23.299032 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:23.299450 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:23.477573 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:23.485308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b21d51b7-1efb-46d5-b717-c2babacb1a08 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.202565 Aug 24 17:37:23.485965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 569/1202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:23 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:24.068406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b46496be-b44d-494d-9a57-754a6e7c77a2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c941f43-d31f-4207-acaa-fe9ec43355da"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:24.071187 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b46496be-b44d-494d-9a57-754a6e7c77a2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:24.078491 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b46496be-b44d-494d-9a57-754a6e7c77a2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:24.079039 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b46496be-b44d-494d-9a57-754a6e7c77a2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:24.079495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b46496be-b44d-494d-9a57-754a6e7c77a2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:24.080227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b46496be-b44d-494d-9a57-754a6e7c77a2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:24.080694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b46496be-b44d-494d-9a57-754a6e7c77a2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:24.081136 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b46496be-b44d-494d-9a57-754a6e7c77a2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:24.218278 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:24.218984 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:24.226346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:24.226833 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:24.227488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:24.228521 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:24.228980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:24.229406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:24.388853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:24.404741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:24.406948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:24.408427 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-15768407-06bf-416b-abed-b03659b35471 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.194444 Aug 24 17:37:24.408998 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 570/1203] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:24 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:24.508986 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:24.509596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:24.515575 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:24.516184 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:24.516628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:24.517479 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:24.518099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:24.518751 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:24.672412 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:24.684690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fbbf52b2-5f4b-4575-ac8b-f6e75e7af218 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.179410 Aug 24 17:37:24.685303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 571/1204] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:24 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:25.432265 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:25.432935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:25.439983 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:25.440530 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:25.441060 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:25.441774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:25.442231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:25.442659 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:25.685099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:25.685099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:25.685382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:25.685382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9571e1ab-35d0-4fb4-8d29-8f7ece78b48b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.197468 Aug 24 17:37:25.685382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 572/1205] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:25 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:25.710699 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:25.711381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:25.717441 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:25.717934 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:25.718394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:25.719098 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:25.719556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:25.719980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:25.879329 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:25.887177 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f73181f2-f4a5-475b-9303-7c86f6090e52 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.180915 Aug 24 17:37:25.888014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 573/1206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:25 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:25.976142 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:26.312156 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=8 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:26.651215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:26.652131 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:26.659360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:26.660665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:26.661178 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:26.661961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:26.662640 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:26.663188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:26.818660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:26.821276 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:26.829232 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:26.830976 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:26.832993 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d277e402-c5ca-48a4-ab53-4ed78ab3d03f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.186147 Aug 24 17:37:26.833464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 574/1207] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:26 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:26.911691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:26.912654 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:26.920855 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:26.921373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:26.921952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:26.922650 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:26.923133 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:26.923557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:27.061217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:27.069602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-18426594-224b-4496-9d75-628bfcbc34ee tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.163526 Aug 24 17:37:27.070191 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 575/1208] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:26 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:27.872115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:27.872877 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:27.874967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:27.881087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:27.881570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:27.882126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:27.882838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:27.883315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:27.883740 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:28.036636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:28.046080 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:28.047760 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:28.049207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-30b24872-6c36-4bea-b079-774145cbd8bc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.195541 Aug 24 17:37:28.061512 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 576/1209] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:27 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:28.096234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:28.096881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:28.103676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:28.104174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:28.104617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:28.105524 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:28.105982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:28.106434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:28.252918 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:28.261285 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-42a32636-ec6f-4d0b-99f3-c8435aca4ed1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.169034 Aug 24 17:37:28.261864 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 577/1210] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:28 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:29.073727 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:29.074663 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:29.082134 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:29.082675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:29.083147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:29.083869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:29.084644 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:29.085092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:29.237961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:29.247503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:29.249043 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:29.250257 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c55f6ae9-f972-42b0-95f8-03eac46670a6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.180463 Aug 24 17:37:29.250832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 578/1211] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:29 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:29.281872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:29.282488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:29.289395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:29.289926 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:29.290374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:29.291101 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:29.291559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:29.291982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:29.428082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:29.436918 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4754c7b0-ef97-4356-95f7-b9d28e697e44 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.159053 Aug 24 17:37:29.437886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 579/1212] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:29 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:30.274475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:30.275168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:30.282421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:30.283105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:30.283539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:30.284334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:30.285385 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:30.285835 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:30.438275 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:30.447714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:30.449218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:30.450384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-970931db-f5ed-4e20-a748-73d9e86af8d6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.180700 Aug 24 17:37:30.450961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 580/1213] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:30 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:30.459723 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:30.460499 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:30.467172 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:30.467881 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:30.468441 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:30.469234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:30.469787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:30.470304 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:30.620168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:30.631884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0bde3bf6-f48e-4662-847a-caf1f594c43f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.176231 Aug 24 17:37:30.632856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 581/1214] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:30 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:31.478192 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:31.478877 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:31.485766 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:31.486273 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:31.486874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:31.487636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:31.488241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:31.488781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:31.653193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:31.661905 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:31.663437 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:31.664766 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-082c5662-639c-40c3-b0e8-e6d2375d6466 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.190549 Aug 24 17:37:31.665576 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 582/1215] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:31 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:31.670288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:31.673655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:31.677968 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:31.678471 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:31.679152 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:31.679893 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:31.680361 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:31.680795 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:31.828294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:31.839729 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-97d22245-6747-40e0-8349-d5cf97e752da tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.173081 Aug 24 17:37:31.842587 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 583/1216] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:31 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:32.688980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:32.689681 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:32.697382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:32.697869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:32.698299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:32.699095 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:32.699540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:32.699959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:32.837434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:32.845635 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:32.847364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:32.848616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0b2998c7-fa1d-45ca-8e5e-a378342d476a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.163524 Aug 24 17:37:32.849188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 584/1217] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:32 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:32.867960 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:32.868565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:32.876656 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:32.877594 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:32.878889 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:32.879918 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:32.880387 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:32.880817 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:33.037030 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:33.045749 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ce49cf6-06ed-408c-b278-fb817133456b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.181496 Aug 24 17:37:33.046342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 585/1218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:32 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:33.874798 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:33.875468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:33.883648 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:33.884147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:33.884725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:33.885289 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:33.885733 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:33.886212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:34.075322 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=19 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:34.079596 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:34.089473 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:34.091073 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:34.092307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-138f4eb6-3bf9-4b93-a940-05d17a153421 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.222829 Aug 24 17:37:34.092875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 586/1219] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:33 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:34.098548 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:34.105935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:34.105935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:34.106166 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:34.106445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:34.107174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:34.107631 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:34.108105 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:34.192791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:34.249967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:34.258764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4b8b65c2-5c6f-4208-a592-56421fe33fb3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.164876 Aug 24 17:37:34.259443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 587/1220] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:34 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:35.119653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:35.120452 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:35.127045 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:35.127541 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:35.127975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:35.129237 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:35.129745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:35.130167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:35.288443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:35.299186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:35.307320 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:35.309215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-becebb74-0a8b-4dcd-9665-682f2d078f95 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.193229 Aug 24 17:37:35.309819 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 588/1221] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:35 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:35.315281 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:35.316672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:35.327029 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:35.327854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:35.328570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:35.329767 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:35.330564 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:35.332007 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:35.485305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:35.493691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b1b272f3-1955-4f31-95e9-52ec2a072e5b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.182786 Aug 24 17:37:35.494272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 589/1222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:35 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:36.333921 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:36.334616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:36.341408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:36.341890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:36.342325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:36.343066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:36.343514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:36.343935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:36.481215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:36.489670 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:36.491214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:36.492359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-cbdaf794-bb5f-416c-87ce-f6c0d1108b5d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.162404 Aug 24 17:37:36.492909 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 590/1223] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:36 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:36.514149 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:36.514788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:36.521533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:36.522011 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:36.522583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:36.523188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:36.523643 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:36.524067 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:36.540489 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:36.659560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:36.667314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-05e5eab9-447f-45c8-ad92-a5a56625fdff tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.157457 Aug 24 17:37:36.667900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 591/1224] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:36 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:37.515869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:37.516559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:37.523526 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:37.524000 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:37.524429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:37.525110 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:37.525560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:37.525981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:37.658107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:37.670866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:37.672544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:37.673724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d8105e84-6f69-4d6e-85a8-797e8842cd68 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.161785 Aug 24 17:37:37.674294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 592/1225] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:37 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:37.687757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:37.688458 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:37.694566 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:37.695091 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:37.695527 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:37.696221 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:37.696666 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:37.697095 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:37.829545 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:37.837710 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-52f5879d-d69b-4c8f-b907-4bd6eebaa088 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.153683 Aug 24 17:37:37.838290 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 593/1226] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:37 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:38.697636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:38.698358 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:38.705532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:38.705717 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:38.706147 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:38.706840 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:38.707315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:38.707797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:38.841521 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:38.850480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:38.852025 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:38.853214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e015359e-49d4-45b3-a26f-0adf3c4c4453 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.159486 Aug 24 17:37:38.853773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 594/1227] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:38 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:38.858833 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:38.859458 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:38.866442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:38.866979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:38.867413 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:38.868128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:38.868573 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:38.869054 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:39.003357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:39.011169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc8329d1-b9c1-464f-b609-94e2a43b0415 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.155690 Aug 24 17:37:39.011728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 595/1228] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:38 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:39.877394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:39.878082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:39.885664 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:39.886156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:39.886595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:39.887331 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:39.887781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:39.888210 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:40.030873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:40.039337 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:40.040824 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:40.041991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aed2c157-d15d-4e2b-8630-651ccd02a628 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.168670 Aug 24 17:37:40.042557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 596/1229] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:39 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:40.047174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:40.047778 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:40.054304 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:40.054785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:40.055263 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:40.055931 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:40.056382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:40.056802 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:40.190468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:40.198984 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83caa6b3-d1ea-4f14-b24e-b636b37ebdf3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.155402 Aug 24 17:37:40.199575 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 597/1230] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:40 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:41.066838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:41.067582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:41.075099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:41.075583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:41.076041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:41.076816 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:41.077264 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:41.077699 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:41.214673 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:41.223894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:41.225922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:41.227128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-def3550f-cfe6-4711-a23f-9184cabec439 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.165297 Aug 24 17:37:41.227696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 598/1231] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:41 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:41.232312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:41.232991 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:41.239035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:41.239520 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:41.239959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:41.241256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:41.241765 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:41.242535 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:41.386261 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:41.393994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c0b6f0f8-906f-45db-8ce4-d7b8ec958036 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.165260 Aug 24 17:37:41.394559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 599/1232] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:41 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:42.251014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:42.251711 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:42.258757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:42.259274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:42.259733 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:42.260461 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:42.260915 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:42.261342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:42.400275 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:42.408868 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:42.410360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:42.411545 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-198425f0-c947-47ad-be54-fe0ad33800f4 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.164541 Aug 24 17:37:42.412124 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 600/1233] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:42 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:42.419287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:42.419896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:42.425995 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:42.426475 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:42.426923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:42.427626 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:42.428081 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:42.428500 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:42.561754 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:42.569603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-879fc7fc-e6b9-45ff-a481-e453a4580c10 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.153921 Aug 24 17:37:42.570184 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 601/1234] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:42 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:43.434843 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:43.435611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:43.441921 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:43.442404 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:43.442842 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:43.443614 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:43.444252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:43.444866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:43.586222 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:43.594429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:43.596071 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:43.597409 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-223078b9-94d0-475f-94f7-a0c5cabd607e tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.166528 Aug 24 17:37:43.597977 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 602/1235] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:43 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:43.602357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:43.603169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:43.609958 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:43.610555 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:43.611234 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:43.612219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:43.612890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:43.613324 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:43.756946 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:43.764636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-aaa7875c-ed35-4f62-93a5-8b261f0b20e0 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.165721 Aug 24 17:37:43.765207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 603/1236] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:43 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:44.620804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:44.621497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:44.631967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:44.632456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:44.632901 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:44.633602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:44.634055 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:44.634482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:44.762013 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:37:44.762644 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Wed Aug 24 17:37:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments (ip 10.222.0.18) !!! Aug 24 17:37:44.772012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:44.780010 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:44.781538 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:44.782749 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-239e03fe-0e51-4c34-8713-f63ca1b337b6 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.165833 Aug 24 17:37:44.783494 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 604/1237] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:44 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:44.789067 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:44.789674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:44.795899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:44.796406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:44.796838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:44.797520 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:44.797970 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:44.798391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:44.935829 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:44.944025 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a33f0cec-c92e-4984-9920-ad4dc848f86b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.159083 Aug 24 17:37:44.944764 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 605/1238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:44 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:45.805788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:45.806482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:45.813621 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:45.814102 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:45.814543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:45.815520 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:45.815962 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:45.816617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:45.951740 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:45.960704 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:45.961852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:45.963046 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dee21185-53f9-4bc7-ad8d-be1ce40640c5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.161265 Aug 24 17:37:45.963607 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 606/1239] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:45 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:45.968082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:45.968679 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:45.974892 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:45.975560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:45.975998 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:45.976690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:45.977137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:45.977559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:46.119268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:46.126878 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3f4b03db-a436-4044-9172-b974965adee9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.162276 Aug 24 17:37:46.127477 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 607/1240] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:45 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:46.725317 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b46496be-b44d-494d-9a57-754a6e7c77a2 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 22.661670 Aug 24 17:37:46.726291 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 634/1241] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:37:24 2022] POST /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments => generated 194 bytes in 22663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:46.992785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:46.993402 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:47.000892 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:47.001385 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:47.002753 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:47.003514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:47.007405 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:47.007405 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:47.007926 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=100 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:47.148760 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:47.149391 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:47.156195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:47.157309 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:47.157761 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:47.158475 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:47.158962 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:47.159395 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:47.162714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:47.172061 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:47.173568 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:47.174745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac663fe8-a0a9-4fda-9c3b-4ccc6a98df7a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.186400 Aug 24 17:37:47.175457 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 608/1242] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:46 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:47.303057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:47.311637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4f586c25-351c-4fcd-88e5-bdeff5ed7d3f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.167915 Aug 24 17:37:47.313639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 635/1243] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:47 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:48.199381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:48.199917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:48.206077 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:48.206566 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:48.207039 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:48.207734 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:48.208191 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:48.208620 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:48.334065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:48.336304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:48.342604 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:48.343480 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:48.343976 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:48.344417 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:48.345125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:48.345577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:48.346007 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:48.355183 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:48.356896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:48.358305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5763b757-6a2b-4e98-8759-215b07f73490 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.162974 Aug 24 17:37:48.359544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 609/1244] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:48 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:48.482806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:48.491646 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-261035db-5806-4a73-944b-0758468782a1 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.161427 Aug 24 17:37:48.492230 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 636/1245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:48 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:49.382303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:49.382980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:49.389484 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:49.389969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:49.390401 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:49.391123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:49.391574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:49.391996 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:49.512634 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:49.513342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:49.520153 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:49.520632 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:49.521065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:49.521758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:49.522240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:49.522663 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:49.540379 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:49.549508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:49.551066 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:49.552298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9f53f83c-b3d3-470f-8368-7a25c71c4144 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.174428 Aug 24 17:37:49.552869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 610/1246] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:49 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:49.657061 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:49.666342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-565aebaa-3bd1-4c6f-8f47-444ab53a7a09 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.157567 Aug 24 17:37:49.666939 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 637/1247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:49 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:50.413387 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8d9e7618-c8ab-447f-a39c-93a1627a5d6a req-d5786f33-8608-4a10-a483-49aa1401a3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127fd694-1843-4ba5-97aa-2565c01c30c2", "name": "network-vif-plugged", "status": "completed", "tag": "dc1417c8-efa2-4bc9-882a-0f8de0684957"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:50.423566 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8d9e7618-c8ab-447f-a39c-93a1627a5d6a req-d5786f33-8608-4a10-a483-49aa1401a3f6 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:50.424051 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8d9e7618-c8ab-447f-a39c-93a1627a5d6a req-d5786f33-8608-4a10-a483-49aa1401a3f6 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:50.424483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8d9e7618-c8ab-447f-a39c-93a1627a5d6a req-d5786f33-8608-4a10-a483-49aa1401a3f6 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:50.436427 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8d9e7618-c8ab-447f-a39c-93a1627a5d6a req-d5786f33-8608-4a10-a483-49aa1401a3f6 service nova] Creating event network-vif-plugged:dc1417c8-efa2-4bc9-882a-0f8de0684957 for instance 127fd694-1843-4ba5-97aa-2565c01c30c2 on hv-cinder-85164 Aug 24 17:37:50.441533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8d9e7618-c8ab-447f-a39c-93a1627a5d6a req-d5786f33-8608-4a10-a483-49aa1401a3f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Aug 24 17:37:50.442126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 611/1248] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:50.579628 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:50.579628 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:50.585179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:50.585687 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:50.586145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:50.586820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:50.587296 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:50.587713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:50.688312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:50.694005 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:50.697185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:50.697680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:50.698117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:50.698821 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:50.699309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:50.699737 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:50.731713 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:50.740390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:50.742629 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:50.743856 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4a7afbda-13c6-4c12-b327-89769cf1f41f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.171066 Aug 24 17:37:50.744432 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 638/1249] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:50 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:50.836555 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:50.845030 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a0aa317-e1f8-4fea-8e22-3268e2efd975 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.160944 Aug 24 17:37:50.845736 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 612/1250] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:50 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:51.767247 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:51.767970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:51.774817 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:51.775321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:51.775761 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:51.776454 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:51.776933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:51.777375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:51.865778 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:51.866460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:51.869577 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=98 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:37:51.875260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:51.875748 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:51.876182 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:51.876942 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:51.877396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:51.877818 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:51.917926 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:51.926759 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:51.928345 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:51.930123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4e6f1219-9184-4e19-96e9-40955847e268 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.167127 Aug 24 17:37:51.930697 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 639/1251] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:51 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:52.032193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:52.040574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a17781f2-2bb1-403f-9d2c-6cb9cec750a3 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.178730 Aug 24 17:37:52.041174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 613/1252] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:51 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:52.953980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:52.954554 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:52.961203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:52.961696 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:52.962145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:52.962877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:52.963367 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:52.963821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:53.067492 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:53.069725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:53.078032 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:53.078583 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:53.079064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:53.079791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:53.080482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:53.081544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:53.151250 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:53.165020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:53.166772 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:53.168054 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ae027a9e-5463-403e-b1c3-078cef056336 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.218082 Aug 24 17:37:53.179714 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 640/1253] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:52 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:37:53.250870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:53.259361 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a23f67c-a2c5-45ae-8e95-d429e60b68c2 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.200884 Aug 24 17:37:53.259952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 614/1254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:53 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:54.192238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:54.193171 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:54.200396 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:54.200985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:54.201521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:54.202308 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:54.203058 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:54.203845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:54.282545 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:54.284064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:54.289948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:54.290667 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:54.291318 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:54.291890 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:54.292345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:54.292779 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:54.391473 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:54.407890 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:54.408191 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:54.409617 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cfd35ce1-22b8-4a60-b855-757cf488665b tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1731 microversion: 2.20 time: 0.221373 Aug 24 17:37:54.410542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 641/1255] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:54 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:54.472416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:54.481255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e6e42092-bde0-45ac-86ce-4c5803be70ed tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.202531 Aug 24 17:37:54.481848 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 615/1256] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:54 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:54.535643 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-9a55e4d5-803d-4244-b51d-0c7b53056072 req-432ad5ef-557d-4a1a-b398-f8c873ef01d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b", "name": "network-vif-plugged", "status": "completed", "tag": "54ee51a3-c6d8-4bba-ade2-885300b52ffb"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:54.546588 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-9a55e4d5-803d-4244-b51d-0c7b53056072 req-432ad5ef-557d-4a1a-b398-f8c873ef01d7 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:54.547168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-9a55e4d5-803d-4244-b51d-0c7b53056072 req-432ad5ef-557d-4a1a-b398-f8c873ef01d7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:54.547477 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-9a55e4d5-803d-4244-b51d-0c7b53056072 req-432ad5ef-557d-4a1a-b398-f8c873ef01d7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:54.559596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-9a55e4d5-803d-4244-b51d-0c7b53056072 req-432ad5ef-557d-4a1a-b398-f8c873ef01d7 service nova] Creating event network-vif-plugged:54ee51a3-c6d8-4bba-ade2-885300b52ffb for instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b on hv-cinder-85164 Aug 24 17:37:54.564980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-9a55e4d5-803d-4244-b51d-0c7b53056072 req-432ad5ef-557d-4a1a-b398-f8c873ef01d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033233 Aug 24 17:37:54.571082 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 642/1257] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:55.441896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:55.442532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:55.449616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:55.450094 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:55.450529 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:55.451255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:55.451771 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:55.455431 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:55.505387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:55.506221 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:55.513592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:55.514088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:55.514536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:55.515273 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:55.515793 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:55.516228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:55.639888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:55.649857 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:55.651930 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:55.652917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a2c7a04-a048-4b31-be60-8ed9b0e9cfe5 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1718 microversion: 2.20 time: 0.215079 Aug 24 17:37:55.653746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 616/1258] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:37:55 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1718 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:37:55.687331 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:55.695332 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-13677104-e767-4f6f-b67c-1a289fa5b500 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.194856 Aug 24 17:37:55.695916 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 643/1259] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:55 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:37:56.716626 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:56.717567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:56.724929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:56.725421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:56.725981 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:56.727250 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:56.727721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:56.728150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:56.874556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:56.882886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c1f0b54e-f19d-49fe-ac39-5cdc8df923a7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.169643 Aug 24 17:37:56.883479 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 617/1260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:56 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:57.482145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e608e52f-5d85-4c37-ac1e-a094cc329394 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:57.484499 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e608e52f-5d85-4c37-ac1e-a094cc329394 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:57.491416 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e608e52f-5d85-4c37-ac1e-a094cc329394 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:57.491913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e608e52f-5d85-4c37-ac1e-a094cc329394 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:57.492358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e608e52f-5d85-4c37-ac1e-a094cc329394 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:57.493127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e608e52f-5d85-4c37-ac1e-a094cc329394 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:57.493992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e608e52f-5d85-4c37-ac1e-a094cc329394 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:57.493992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e608e52f-5d85-4c37-ac1e-a094cc329394 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:57.525495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e608e52f-5d85-4c37-ac1e-a094cc329394 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047308 Aug 24 17:37:57.526077 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 644/1261] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:37:57 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:57.539089 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5610103c-d746-498a-b715-b579e6bf6a0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:57.539619 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5610103c-d746-498a-b715-b579e6bf6a0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:57.545667 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610103c-d746-498a-b715-b579e6bf6a0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:57.546267 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610103c-d746-498a-b715-b579e6bf6a0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:57.546582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610103c-d746-498a-b715-b579e6bf6a0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:57.547321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610103c-d746-498a-b715-b579e6bf6a0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:57.547758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610103c-d746-498a-b715-b579e6bf6a0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:57.548276 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5610103c-d746-498a-b715-b579e6bf6a0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:57.587749 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5610103c-d746-498a-b715-b579e6bf6a0e tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/5c941f43-d31f-4207-acaa-fe9ec43355da" status: 200 len: 194 microversion: 2.1 time: 0.052547 Aug 24 17:37:57.588272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 618/1262] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Aug 24 17:37:57 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/5c941f43-d31f-4207-acaa-fe9ec43355da => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:37:57.908321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:57.909065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:57.919864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:57.920665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:57.921396 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:57.922540 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:57.923250 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:57.923978 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:58.066935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:58.079281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-09a4cb51-0a9f-4c42-bef4-b17ad57c338f tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1367 microversion: 2.1 time: 0.177636 Aug 24 17:37:58.079884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 645/1263] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:57 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:59.102613 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:59.104245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:59.112490 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:59.112983 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:59.114238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:59.114979 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:59.115446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:59.115880 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:59.263911 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:37:59.273145 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d7bb14ff-b95f-4b64-81b0-2f58e7047018 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1555 microversion: 2.1 time: 0.175638 Aug 24 17:37:59.273716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 619/1264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:37:59 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:37:59.294855 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-190f6bf4-6fcf-42b5-9cdf-9ab0385fc22b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:37:59.296782 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-190f6bf4-6fcf-42b5-9cdf-9ab0385fc22b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:59.301662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-190f6bf4-6fcf-42b5-9cdf-9ab0385fc22b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:59.302365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-190f6bf4-6fcf-42b5-9cdf-9ab0385fc22b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:59.302577 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-190f6bf4-6fcf-42b5-9cdf-9ab0385fc22b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:59.304699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-190f6bf4-6fcf-42b5-9cdf-9ab0385fc22b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:59.304699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-190f6bf4-6fcf-42b5-9cdf-9ab0385fc22b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:59.304925 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-190f6bf4-6fcf-42b5-9cdf-9ab0385fc22b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:59.360717 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49461460-89be-4a07-8203-05e9a4debeb7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "759a4999-6512-4f9a-9e50-8fa9d075902b"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:37:59.360717 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-49461460-89be-4a07-8203-05e9a4debeb7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:37:59.367028 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49461460-89be-4a07-8203-05e9a4debeb7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:59.367742 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49461460-89be-4a07-8203-05e9a4debeb7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:59.368181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49461460-89be-4a07-8203-05e9a4debeb7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:59.368952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49461460-89be-4a07-8203-05e9a4debeb7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:37:59.369641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49461460-89be-4a07-8203-05e9a4debeb7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:37:59.370394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-49461460-89be-4a07-8203-05e9a4debeb7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:37:59.393596 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-190f6bf4-6fcf-42b5-9cdf-9ab0385fc22b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103229 Aug 24 17:37:59.394193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 646/1265] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Aug 24 17:37:59 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:38:00.342249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49461460-89be-4a07-8203-05e9a4debeb7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "POST /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.987966 Aug 24 17:38:00.343314 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 620/1266] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:37:59 2022] POST /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments => generated 194 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:38:00.824002 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-0d0afce6-ed81-4da6-90e7-1370d99c340a req-506eb8c4-dc89-42db-bce6-185a3fef7e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b", "tag": "54ee51a3-c6d8-4bba-ade2-885300b52ffb"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:38:00.839139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-0d0afce6-ed81-4da6-90e7-1370d99c340a req-506eb8c4-dc89-42db-bce6-185a3fef7e1a service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:00.840051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-0d0afce6-ed81-4da6-90e7-1370d99c340a req-506eb8c4-dc89-42db-bce6-185a3fef7e1a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:00.840556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-0d0afce6-ed81-4da6-90e7-1370d99c340a req-506eb8c4-dc89-42db-bce6-185a3fef7e1a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:00.853830 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-0d0afce6-ed81-4da6-90e7-1370d99c340a req-506eb8c4-dc89-42db-bce6-185a3fef7e1a service nova] Creating event network-changed:54ee51a3-c6d8-4bba-ade2-885300b52ffb for instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b on hv-cinder-85164 Aug 24 17:38:00.860541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-0d0afce6-ed81-4da6-90e7-1370d99c340a req-506eb8c4-dc89-42db-bce6-185a3fef7e1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040351 Aug 24 17:38:00.860541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 647/1267] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:38:09.046203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1287cdc4-9b45-486e-91a5-094bff0be5fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:09.048745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1287cdc4-9b45-486e-91a5-094bff0be5fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:09.056092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1287cdc4-9b45-486e-91a5-094bff0be5fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:09.056573 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1287cdc4-9b45-486e-91a5-094bff0be5fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:09.057006 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1287cdc4-9b45-486e-91a5-094bff0be5fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:09.057699 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1287cdc4-9b45-486e-91a5-094bff0be5fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:09.058143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1287cdc4-9b45-486e-91a5-094bff0be5fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:09.058565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1287cdc4-9b45-486e-91a5-094bff0be5fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:09.090579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1287cdc4-9b45-486e-91a5-094bff0be5fd tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048808 Aug 24 17:38:09.091190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 621/1268] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:38:09 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:38:09.210739 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4ec28475-fbe5-4bb6-8828-c8a78208b3a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:09.211658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4ec28475-fbe5-4bb6-8828-c8a78208b3a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:09.221009 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ec28475-fbe5-4bb6-8828-c8a78208b3a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:09.221514 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ec28475-fbe5-4bb6-8828-c8a78208b3a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:09.221964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ec28475-fbe5-4bb6-8828-c8a78208b3a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:09.222687 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ec28475-fbe5-4bb6-8828-c8a78208b3a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:09.223186 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ec28475-fbe5-4bb6-8828-c8a78208b3a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:09.223623 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4ec28475-fbe5-4bb6-8828-c8a78208b3a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:09.256384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4ec28475-fbe5-4bb6-8828-c8a78208b3a6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/5c941f43-d31f-4207-acaa-fe9ec43355da" status: 200 len: 194 microversion: 2.1 time: 0.053437 Aug 24 17:38:09.257573 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 648/1269] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Aug 24 17:38:09 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/5c941f43-d31f-4207-acaa-fe9ec43355da => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:38:09.272012 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:09.272948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:09.279505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:09.280011 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:09.280454 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:09.281159 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:09.281612 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:09.282107 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:09.368389 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lazy-loading 'services' on Instance uuid 099029bf-c329-4621-aa89-fa1e5513e667 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:38:09.594683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-af685dd7-2dd0-46f8-86f6-8a5fca815931 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "DELETE /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/5c941f43-d31f-4207-acaa-fe9ec43355da" status: 202 len: 0 microversion: 2.1 time: 0.329907 Aug 24 17:38:09.595892 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 622/1270] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:38:09 2022] DELETE /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/5c941f43-d31f-4207-acaa-fe9ec43355da => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:38:11.792291 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-587d8e9c-47f5-459e-b431-1e70a054431c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:11.793175 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-587d8e9c-47f5-459e-b431-1e70a054431c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:11.799369 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-587d8e9c-47f5-459e-b431-1e70a054431c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:11.799847 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-587d8e9c-47f5-459e-b431-1e70a054431c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:11.801143 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-587d8e9c-47f5-459e-b431-1e70a054431c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:11.801143 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-587d8e9c-47f5-459e-b431-1e70a054431c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:11.801374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-587d8e9c-47f5-459e-b431-1e70a054431c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:11.801796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-587d8e9c-47f5-459e-b431-1e70a054431c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:11.833289 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-587d8e9c-47f5-459e-b431-1e70a054431c tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/759a4999-6512-4f9a-9e50-8fa9d075902b" status: 200 len: 194 microversion: 2.1 time: 0.047165 Aug 24 17:38:11.833892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 649/1271] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Aug 24 17:38:11 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/759a4999-6512-4f9a-9e50-8fa9d075902b => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:38:11.845772 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:11.846346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:11.854303 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:11.854787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:11.855262 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:11.855968 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:11.856426 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:11.856862 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:11.872304 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:11.942181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lazy-loading 'services' on Instance uuid 099029bf-c329-4621-aa89-fa1e5513e667 {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:38:12.165693 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b385006c-3fe6-4b4f-9280-dcd2e21dd0b6 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "DELETE /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/759a4999-6512-4f9a-9e50-8fa9d075902b" status: 202 len: 0 microversion: 2.1 time: 0.324004 Aug 24 17:38:12.166326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 623/1272] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:38:11 2022] DELETE /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments/759a4999-6512-4f9a-9e50-8fa9d075902b => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:38:14.424273 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-896ff020-295c-41a9-bc57-f5f53d48ab2a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:14.426436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-896ff020-295c-41a9-bc57-f5f53d48ab2a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:14.433450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896ff020-295c-41a9-bc57-f5f53d48ab2a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:14.433950 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896ff020-295c-41a9-bc57-f5f53d48ab2a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:14.436746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896ff020-295c-41a9-bc57-f5f53d48ab2a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:14.436746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896ff020-295c-41a9-bc57-f5f53d48ab2a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:14.436746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896ff020-295c-41a9-bc57-f5f53d48ab2a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:14.436746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896ff020-295c-41a9-bc57-f5f53d48ab2a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:14.467394 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-896ff020-295c-41a9-bc57-f5f53d48ab2a tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046977 Aug 24 17:38:14.467965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 650/1273] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:38:14 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:38:14.606191 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d9243d3-7340-447e-94e7-ad9f0f73496b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:14.608652 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1d9243d3-7340-447e-94e7-ad9f0f73496b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:14.615308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d9243d3-7340-447e-94e7-ad9f0f73496b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:14.615793 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d9243d3-7340-447e-94e7-ad9f0f73496b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:14.616790 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d9243d3-7340-447e-94e7-ad9f0f73496b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:14.617483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d9243d3-7340-447e-94e7-ad9f0f73496b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:14.618183 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d9243d3-7340-447e-94e7-ad9f0f73496b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:14.618183 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1d9243d3-7340-447e-94e7-ad9f0f73496b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:14.649409 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d9243d3-7340-447e-94e7-ad9f0f73496b tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048305 Aug 24 17:38:14.649985 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 624/1274] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:38:14 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:38:14.724575 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:14.725204 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:14.727366 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=33 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:14.732245 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:14.732767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:14.733203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:14.733903 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:14.734357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:14.734785 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:14.762699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:38:14.766402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:15.087155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3b60d203-74b2-4529-b11b-c83ff48a94f3 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "DELETE /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 204 len: 0 microversion: 2.1 time: 0.366532 Aug 24 17:38:15.087744 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 651/1275] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:38:14 2022] DELETE /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:38:15.097004 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:15.099710 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:15.107834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:15.108373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:15.108838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:15.109519 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:15.109968 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:15.110394 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:15.256163 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:38:15.264889 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fdbc4bcf-163c-453a-9bff-4c451afd237f tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1673 microversion: 2.1 time: 0.171984 Aug 24 17:38:15.265483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 625/1276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:38:15 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:38:16.286849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:16.287571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:16.296530 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:16.297085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:16.297569 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:16.298406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:16.298948 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:16.299479 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:16.458042 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:38:16.470236 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3fa53ce2-7caa-4626-a0e0-892ece860cc8 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1673 microversion: 2.1 time: 0.187495 Aug 24 17:38:16.471263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 652/1277] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:38:16 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:38:17.494245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:17.495251 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:17.506821 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:17.508237 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:17.508953 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:17.509950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:17.510543 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:17.511206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:17.687911 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:38:17.696144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a6ded516-0fa6-487b-9655-7f70cb6f0c79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1673 microversion: 2.1 time: 0.207471 Aug 24 17:38:17.696734 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 626/1278] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:38:17 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1673 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:38:18.724660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:18.725869 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:18.737538 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:18.738194 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:18.739020 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:18.740282 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:18.740846 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:18.741377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:18.926982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:38:18.940365 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-896fb529-afbe-4a35-9c99-0142987bfb79 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1673 microversion: 2.1 time: 0.223109 Aug 24 17:38:18.941366 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 653/1279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:38:18 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:38:19.498651 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-218fc6f6-9623-423c-91a7-f95a9b55229d req-054e87d9-a5ef-4094-ae6d-b08ddaaad758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099029bf-c329-4621-aa89-fa1e5513e667", "name": "network-vif-deleted", "tag": "fcb808aa-e240-4d9a-aa4d-b616739ece07"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:38:19.519460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-218fc6f6-9623-423c-91a7-f95a9b55229d req-054e87d9-a5ef-4094-ae6d-b08ddaaad758 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:19.519460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-218fc6f6-9623-423c-91a7-f95a9b55229d req-054e87d9-a5ef-4094-ae6d-b08ddaaad758 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:19.519460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-218fc6f6-9623-423c-91a7-f95a9b55229d req-054e87d9-a5ef-4094-ae6d-b08ddaaad758 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:19.537167 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-218fc6f6-9623-423c-91a7-f95a9b55229d req-054e87d9-a5ef-4094-ae6d-b08ddaaad758 service nova] Creating event network-vif-deleted:fcb808aa-e240-4d9a-aa4d-b616739ece07 for instance 099029bf-c329-4621-aa89-fa1e5513e667 on hv-cinder-85164 Aug 24 17:38:19.544672 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-218fc6f6-9623-423c-91a7-f95a9b55229d req-054e87d9-a5ef-4094-ae6d-b08ddaaad758 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049619 Aug 24 17:38:19.545600 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 627/1280] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:38:19.973290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:19.975159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:19.987409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:19.988387 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:19.989133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:19.990350 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:19.991867 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:19.992311 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:20.032517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:20.033006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:20.033444 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:20.033896 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lazy-loading 'fault' on Instance uuid 099029bf-c329-4621-aa89-fa1e5513e667 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:38:20.098213 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9e96b709b345c08a4ea10f14211668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8612c530e1495f8d6f4927560a9012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:38:20.112769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1ce8e7c0-98a0-40e9-bef9-088e2a863c92 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 200 len: 1327 microversion: 2.1 time: 0.143634 Aug 24 17:38:20.114517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 654/1281] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:38:19 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 1327 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:38:21.136353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:21.136969 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:21.143472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:21.143957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:21.144591 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:21.145400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:21.145848 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:21.146274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:21.161749 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] HTTP exception thrown: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Request method failure captured: Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 HTTP/1.1 Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8j5zFz2233Z-4Le0ICLal1aeDW83aa8-mIeD_Dc2LE7PtEXQ_qqyYyzscxZJ400Qqj9wo_PtZvdx7EmhuGIQNQjU_w1MwbDicd7tQs0FOlTrxS0d02cYATOQ4pSUSp7lbU9s6ErDhmWRqi1tqW5JKHTKAlexwBmcLhduopfQJrkuU Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:38:21.164144 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6c8612c530e1495f8d6f4927560a9012", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: ef9e96b709b345c08a4ea10f14211668 Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:21.165875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '099029bf-c329-4621-aa89-fa1e5513e667'} Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:38:21.166677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:21.168057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:21.169445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Returning 404 to user: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:38:21.169445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c2048a33-8c16-482c-9d9c-d5c6679c82e0 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 404 len: 111 microversion: 2.1 time: 0.034266 Aug 24 17:38:21.169445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 628/1282] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:38:21 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:38:21.177482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f16acbf1-f658-4af4-8fc5-7e0fe486b5f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '.version_select at 0x7f3f346cf4c0>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:21.264390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f16acbf1-f658-4af4-8fc5-7e0fe486b5f4 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441586037" status: 202 len: 0 microversion: 2.1 time: 0.093190 Aug 24 17:38:21.265050 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 655/1283] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 24 17:38:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441586037 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:38:24.825873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:24.826523 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:24.828968 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=32 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:38:24.834207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:24.834759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:24.835830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:24.836580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:24.837036 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:24.837462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:24.852007 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] HTTP exception thrown: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Request method failure captured: Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 HTTP/1.1 Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8j5zFz2233Z-4Le0ICLal1aeDW83aa8-mIeD_Dc2LE7PtEXQ_qqyYyzscxZJ400Qqj9wo_PtZvdx7EmhuGIQNQjU_w1MwbDicd7tQs0FOlTrxS0d02cYATOQ4pSUSp7lbU9s6ErDhmWRqi1tqW5JKHTKAlexwBmcLhduopfQJrkuU Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:38:24.853743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6c8612c530e1495f8d6f4927560a9012", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: ef9e96b709b345c08a4ea10f14211668 Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.855462 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '099029bf-c329-4621-aa89-fa1e5513e667'} Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:38:24.856395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.857899 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.859488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Returning 404 to user: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:38:24.859488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-11baf156-8383-4ef4-a0c0-edb6653d49eb tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "DELETE /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 404 len: 111 microversion: 2.1 time: 0.033229 Aug 24 17:38:24.859488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 629/1284] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:38:24 2022] DELETE /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:38:24.866585 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:24.868018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 099029bf-c329-4621-aa89-fa1e5513e667] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:24.876651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:24.877152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:24.877824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:24.878558 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:24.879053 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:24.879486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:24.895238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] HTTP exception thrown: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Request method failure captured: Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 HTTP/1.1 Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8j5zFz2233Z-4Le0ICLal1aeDW83aa8-mIeD_Dc2LE7PtEXQ_qqyYyzscxZJ400Qqj9wo_PtZvdx7EmhuGIQNQjU_w1MwbDicd7tQs0FOlTrxS0d02cYATOQ4pSUSp7lbU9s6ErDhmWRqi1tqW5JKHTKAlexwBmcLhduopfQJrkuU Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:38:24.896920 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6c8612c530e1495f8d6f4927560a9012", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: ef9e96b709b345c08a4ea10f14211668 Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.899214 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '099029bf-c329-4621-aa89-fa1e5513e667'} Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:38:24.900116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. Aug 24 17:38:24.901598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:24.902881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Returning 404 to user: Instance 099029bf-c329-4621-aa89-fa1e5513e667 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:38:24.902881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-04cd3b35-2baa-47f3-9c72-8e9aae5b0aba tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667" status: 404 len: 111 microversion: 2.1 time: 0.038934 Aug 24 17:38:24.902881 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 656/1285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:38:24 2022] GET /compute/v2.1/servers/099029bf-c329-4621-aa89-fa1e5513e667 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:38:26.262821 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:26.263615 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:26.270814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:26.271342 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:26.271781 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:26.274395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:26.274395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:26.274395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:26.288532 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] HTTP exception thrown: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Request method failure captured: Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e HTTP/1.1 Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8j5zFz2233Z-4Le0ICLal1aeDW83aa8-mIeD_Dc2LE7PtEXQ_qqyYyzscxZJ400Qqj9wo_PtZvdx7EmhuGIQNQjU_w1MwbDicd7tQs0FOlTrxS0d02cYATOQ4pSUSp7lbU9s6ErDhmWRqi1tqW5JKHTKAlexwBmcLhduopfQJrkuU Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:38:26.290853 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6c8612c530e1495f8d6f4927560a9012", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: ef9e96b709b345c08a4ea10f14211668 Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.292885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '483b254a-2178-420a-8a82-111e13dfaa7e'} Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:38:26.293746 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.295238 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.296625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Returning 404 to user: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:38:26.296625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1150e64d-0f21-4b65-b575-0da58eea3755 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "DELETE /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 404 len: 111 microversion: 2.1 time: 0.033317 Aug 24 17:38:26.296625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 630/1286] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:38:26 2022] DELETE /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:38:26.301472 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:38:26.303147 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] [instance: 483b254a-2178-420a-8a82-111e13dfaa7e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:38:26.308941 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:26.309420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:26.309856 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:26.310541 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:38:26.311025 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:38:26.311446 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:38:26.330113 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] HTTP exception thrown: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Request method failure captured: Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e HTTP/1.1 Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8j5zFz2233Z-4Le0ICLal1aeDW83aa8-mIeD_Dc2LE7PtEXQ_qqyYyzscxZJ400Qqj9wo_PtZvdx7EmhuGIQNQjU_w1MwbDicd7tQs0FOlTrxS0d02cYATOQ4pSUSp7lbU9s6ErDhmWRqi1tqW5JKHTKAlexwBmcLhduopfQJrkuU Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:38:26.331731 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6c8612c530e1495f8d6f4927560a9012", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6c8612c530e1495f8d6f4927560a9012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 6c8612c530e1495f8d6f4927560a9012 Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1277197594 Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: ef9e96b709b345c08a4ea10f14211668 Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeTestJSON-1277197594-project Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.333299 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '483b254a-2178-420a-8a82-111e13dfaa7e'} Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:38:26.334237 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. Aug 24 17:38:26.336208 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:38:26.337316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] Returning 404 to user: Instance 483b254a-2178-420a-8a82-111e13dfaa7e could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:38:26.337316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ad614a31-2d1c-4e26-8b65-d54c3a91cff7 tempest-AttachVolumeTestJSON-1277197594 tempest-AttachVolumeTestJSON-1277197594-project] 10.222.0.18 "GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e" status: 404 len: 111 microversion: 2.1 time: 0.035660 Aug 24 17:38:26.337316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 657/1287] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:38:26 2022] GET /compute/v2.1/servers/483b254a-2178-420a-8a82-111e13dfaa7e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:39:07.984426 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:07.985023 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:07.987128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:07.990474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:07.992072 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:07.992250 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:07.997812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:07.998574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:07.999405 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:08.000892 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:08.001755 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:08.002531 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:08.041557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:39:08.152215 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-392c4921-961f-4e6e-a8e8-770e780803f1 req-7a9fd509-45cd-4d02-863c-cd191f37a58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d", "tag": "6ad650fb-2ab0-4c92-bbe5-467990c85e47"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:08.163215 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-392c4921-961f-4e6e-a8e8-770e780803f1 req-7a9fd509-45cd-4d02-863c-cd191f37a58b service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:08.184844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-392c4921-961f-4e6e-a8e8-770e780803f1 req-7a9fd509-45cd-4d02-863c-cd191f37a58b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:08.184844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-392c4921-961f-4e6e-a8e8-770e780803f1 req-7a9fd509-45cd-4d02-863c-cd191f37a58b service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:08.184844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-392c4921-961f-4e6e-a8e8-770e780803f1 req-7a9fd509-45cd-4d02-863c-cd191f37a58b service nova] Creating event network-changed:6ad650fb-2ab0-4c92-bbe5-467990c85e47 for instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d on hv-cinder-85164 Aug 24 17:39:08.184844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-392c4921-961f-4e6e-a8e8-770e780803f1 req-7a9fd509-45cd-4d02-863c-cd191f37a58b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200338 Aug 24 17:39:08.184844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 658/1288] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:39:08.560368 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7f009003-35ea-4902-89c2-50db8a8ab43b tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 204 len: 0 microversion: 2.1 time: 0.580793 Aug 24 17:39:08.562217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 631/1289] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:39:07 2022] DELETE /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:39:08.572371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:08.575894 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:08.583453 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:08.584250 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:08.585770 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:08.586753 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:08.587437 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:08.587848 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:08.814691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:08.827228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a77eb58b-e11d-4bc3-8801-2ba00a20e6ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1576 microversion: 2.1 time: 0.257063 Aug 24 17:39:08.827852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 659/1290] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:08 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1576 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:39:09.851985 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:09.852873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:09.859433 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:09.859924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:09.860354 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:09.861191 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:09.862027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:09.862027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:10.010703 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:10.019961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac76f74c-0d91-4e0e-aae6-751a2968ca9f tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1576 microversion: 2.1 time: 0.173356 Aug 24 17:39:10.034205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 632/1291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:09 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:39:11.054511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:11.055273 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:11.062684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:11.063203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:11.063649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:11.064348 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:11.064806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:11.065455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:11.214697 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:11.224466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-60030ccc-4822-4089-9c68-c2cfac953807 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1457 microversion: 2.1 time: 0.174493 Aug 24 17:39:11.225060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 660/1292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:11 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1457 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:11.660783 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-d44854c4-8741-406e-8321-09210574a12c req-a65c0d69-fee3-4507-b5e6-fc4db4309b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d", "name": "network-vif-deleted", "tag": "6ad650fb-2ab0-4c92-bbe5-467990c85e47"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:11.671598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d44854c4-8741-406e-8321-09210574a12c req-a65c0d69-fee3-4507-b5e6-fc4db4309b5f service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:11.672079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d44854c4-8741-406e-8321-09210574a12c req-a65c0d69-fee3-4507-b5e6-fc4db4309b5f service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:11.674369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-d44854c4-8741-406e-8321-09210574a12c req-a65c0d69-fee3-4507-b5e6-fc4db4309b5f service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:11.684219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-d44854c4-8741-406e-8321-09210574a12c req-a65c0d69-fee3-4507-b5e6-fc4db4309b5f service nova] Creating event network-vif-deleted:6ad650fb-2ab0-4c92-bbe5-467990c85e47 for instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d on hv-cinder-85164 Aug 24 17:39:11.689212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-d44854c4-8741-406e-8321-09210574a12c req-a65c0d69-fee3-4507-b5e6-fc4db4309b5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032216 Aug 24 17:39:11.689957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 633/1293] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:12.248076 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:12.248752 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:12.256069 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:12.256567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:12.257011 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:12.258450 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:12.258943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:12.259408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:12.325621 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:12.334018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b3c5f7ff-2fdf-4748-ba60-0bfcb656ab05 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1225 microversion: 2.1 time: 0.091621 Aug 24 17:39:12.334937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 661/1294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:12 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:12.469063 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a880d05d-0b01-43c0-b1a1-884678c3305a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:12.471735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a880d05d-0b01-43c0-b1a1-884678c3305a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:12.478468 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a880d05d-0b01-43c0-b1a1-884678c3305a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:12.478987 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a880d05d-0b01-43c0-b1a1-884678c3305a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:12.479422 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a880d05d-0b01-43c0-b1a1-884678c3305a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:12.480207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a880d05d-0b01-43c0-b1a1-884678c3305a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:12.480684 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a880d05d-0b01-43c0-b1a1-884678c3305a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:12.481106 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a880d05d-0b01-43c0-b1a1-884678c3305a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:12.521574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a880d05d-0b01-43c0-b1a1-884678c3305a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047551 Aug 24 17:39:12.521574 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 634/1295] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Aug 24 17:39:12 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:12.590947 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:12.594205 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:12.599120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:12.599120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:12.600693 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:12.600693 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:12.601779 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:12.601779 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:12.629959 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:39:12.947924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ab66181c-3b83-4325-9f3f-75997774faf7 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 204 len: 0 microversion: 2.20 time: 0.360628 Aug 24 17:39:12.948518 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 662/1296] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 24 17:39:12 2022] DELETE /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:39:12.956813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:12.958209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:12.965506 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:12.966214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:12.966828 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:12.967750 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:12.968353 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:12.968962 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:13.142118 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:13.151775 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:13.153983 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:13.155463 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7aa61f27-e3a9-423d-a3f7-cf92c061b179 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.202606 Aug 24 17:39:13.156027 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 635/1297] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:39:12 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:39:13.357297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:13.358009 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:13.369887 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:13.370388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:13.370836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:13.372132 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:13.372587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:13.373164 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:13.413179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:13.413701 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:13.414136 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:13.414583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lazy-loading 'fault' on Instance uuid 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:39:13.460891 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:13.468933 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b9c0e607-c3a2-49ba-971e-fae1930b34a5 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 200 len: 1230 microversion: 2.1 time: 0.116667 Aug 24 17:39:13.469515 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 663/1298] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:13 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:14.181095 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:14.181876 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:14.188623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:14.189116 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:14.189553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:14.190275 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:14.190816 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:14.191225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:14.333346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:14.342464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:14.344010 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:14.345282 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a3112ad-21ea-4bf9-856a-e07ef4325abe tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.168392 Aug 24 17:39:14.345748 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 636/1299] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:39:14 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:39:14.491440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:14.492079 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:14.499669 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:14.500159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:14.500606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:14.501329 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:14.501784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:14.502213 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:14.518662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] HTTP exception thrown: Instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d could not be found. Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Request method failure captured: Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d HTTP/1.1 Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl-EL00gZv5DsF1U7Oj6KHwzWHaWOFjNU9U1pvzlzO8AEaiaDiUDx37iG_TuYtAufLjvxkrdXKUqhf-E55_crSILPBAQ1R1CkR9MACa60CoJx3TMOMqe8bPvE7oaQMcOK1Duupmw9y2vRRrM7ixD-JnWceE8ENh1HOcnUl4CHf_nRCk Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:39:14.520360 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_036fc4bf065249e29d0e1e90d23bae19", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 47da700d7d0f4d5cb1ea984a82d643bf Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d could not be found. Aug 24 17:39:14.522359 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d'} Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d could not be found. Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:14.523406 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d could not be found. Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d could not be found. Aug 24 17:39:14.525129 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:14.526580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Returning 404 to user: Instance 8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:14.526580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bdcd7a09-adc6-4049-bf52-09c74a6070f9 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d" status: 404 len: 111 microversion: 2.1 time: 0.034974 Aug 24 17:39:14.526580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 664/1300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:14 2022] GET /compute/v2.1/servers/8f72ff03-aef6-4c3a-8b79-aa4f91f3aa5d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:39:15.368511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:15.369245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:15.376720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:15.377306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:15.377756 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:15.378479 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:15.378954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:15.379389 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:15.525226 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:15.534588 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:15.536268 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:15.537542 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-775228ca-ebb9-4476-a74e-0588c0492e2f tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1724 microversion: 2.20 time: 0.173254 Aug 24 17:39:15.538196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 637/1301] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:39:15 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:39:16.238346 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-93b27b88-448d-4354-83f8-6a233959123d req-bb7042e9-7cb4-4375-bd39-50f4cb0f3803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127fd694-1843-4ba5-97aa-2565c01c30c2", "name": "network-vif-deleted", "tag": "dc1417c8-efa2-4bc9-882a-0f8de0684957"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:16.248671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-93b27b88-448d-4354-83f8-6a233959123d req-bb7042e9-7cb4-4375-bd39-50f4cb0f3803 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:16.249254 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-93b27b88-448d-4354-83f8-6a233959123d req-bb7042e9-7cb4-4375-bd39-50f4cb0f3803 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:16.249772 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-93b27b88-448d-4354-83f8-6a233959123d req-bb7042e9-7cb4-4375-bd39-50f4cb0f3803 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:16.266861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-93b27b88-448d-4354-83f8-6a233959123d req-bb7042e9-7cb4-4375-bd39-50f4cb0f3803 service nova] Creating event network-vif-deleted:dc1417c8-efa2-4bc9-882a-0f8de0684957 for instance 127fd694-1843-4ba5-97aa-2565c01c30c2 on hv-cinder-85164 Aug 24 17:39:16.276211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-93b27b88-448d-4354-83f8-6a233959123d req-bb7042e9-7cb4-4375-bd39-50f4cb0f3803 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045027 Aug 24 17:39:16.282481 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 665/1302] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:16.562565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:16.563860 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:16.571373 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:16.571858 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:16.574367 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:16.574367 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:16.574367 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:16.574367 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:16.644435 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:16.654214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:16.656117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c379c845fccd43c08e8699976d506801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cff6e1349f4bb1a2905e6e5231fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:16.657341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ac4bdcf8-89b0-45ce-9998-289d12f97d83 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 200 len: 1366 microversion: 2.20 time: 0.100451 Aug 24 17:39:16.657964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 638/1303] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:39:16 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:39:17.680985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:17.681685 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:17.687943 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:17.688431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:17.688866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:17.689553 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:17.690006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:17.690436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:17.704767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] HTTP exception thrown: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Request method failure captured: Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 HTTP/1.1 Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8r0X6gglO-ZMlPwgkPYH9ImTSOa9mR-FRUbOaZ__3JqJ-iq3smlaDm9SC_IckWkebKWzvU2D8WwtSGf-PsIUnXR8ic9MZWul36ejPPnFI5cTDjy3TV00QF-FcDG1DeWEEr8Q3R0tVT_Ju7DCD0FmYrA9FnoP3uxX6VQ3BIIlqwnRw Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:39:17.708747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15cff6e1349f4bb1a2905e6e5231fc2d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: c379c845fccd43c08e8699976d506801 Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:17.710438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '127fd694-1843-4ba5-97aa-2565c01c30c2'} Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:17.711385 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:17.712607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:17.713751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Returning 404 to user: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:17.713751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3c3f1eaa-dd6c-47ff-af3e-742b815f5964 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 404 len: 111 microversion: 2.20 time: 0.031620 Aug 24 17:39:17.713751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 666/1304] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:39:17 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:39:17.720039 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-04742955-dcff-4b8f-ab4b-26c2f900776d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '.version_select at 0x7f3f34618a60>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:17.829185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-04742955-dcff-4b8f-ab4b-26c2f900776d tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-427059925" status: 204 len: 0 microversion: 2.20 time: 0.113805 Aug 24 17:39:17.829788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 639/1305] 10.222.0.18 () {60 vars in 1259 bytes} [Wed Aug 24 17:39:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-427059925 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:39:18.344102 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:18.344658 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:18.346689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-0f3fca96-e5b0-4e45-a7d2-131542afa21a req-ed261d11-5792-4fdd-a8a9-f482073a5b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990e4d74-6e7f-42f6-a003-c1a3e2f52449", "tag": "2f546386-f9b9-44c0-8328-7aca5bef1800"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:18.351307 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:18.352006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:18.352606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:18.353457 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:18.353917 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:18.354334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:18.360684 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0f3fca96-e5b0-4e45-a7d2-131542afa21a req-ed261d11-5792-4fdd-a8a9-f482073a5b22 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:18.361255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0f3fca96-e5b0-4e45-a7d2-131542afa21a req-ed261d11-5792-4fdd-a8a9-f482073a5b22 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:18.361754 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-0f3fca96-e5b0-4e45-a7d2-131542afa21a req-ed261d11-5792-4fdd-a8a9-f482073a5b22 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:18.372866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-0f3fca96-e5b0-4e45-a7d2-131542afa21a req-ed261d11-5792-4fdd-a8a9-f482073a5b22 service nova] Creating event network-changed:2f546386-f9b9-44c0-8328-7aca5bef1800 for instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 on hv-cinder-85164 Aug 24 17:39:18.378552 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-0f3fca96-e5b0-4e45-a7d2-131542afa21a req-ed261d11-5792-4fdd-a8a9-f482073a5b22 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036165 Aug 24 17:39:18.379785 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 640/1306] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:39:18.384591 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:39:18.720656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3357926d-5c41-4855-91eb-128e3bf2dcab tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "DELETE /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 204 len: 0 microversion: 2.1 time: 0.381011 Aug 24 17:39:18.721342 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 667/1307] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:39:18 2022] DELETE /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:39:18.731228 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:18.733719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:18.754506 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:18.755682 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:18.756743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:18.757636 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:18.758246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:18.758789 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:18.987674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:18.996544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a757e44-7a97-4c57-b516-6246ae003360 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1575 microversion: 2.1 time: 0.270284 Aug 24 17:39:18.998035 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 641/1308] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:18 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1575 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:39:20.021980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:20.023471 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:20.030377 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:20.030981 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:20.031530 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:20.032316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:20.032871 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:20.033375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:20.174647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:20.182913 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a1c1fa28-564d-456c-8b8a-f5c439ab05ae tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1456 microversion: 2.1 time: 0.165576 Aug 24 17:39:20.191159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 668/1309] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:20 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1456 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:20.409854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-592ae45c-4450-4c53-9518-64aad3edb5a1 req-aaf905a6-9c60-4c12-a7da-4566ebe88532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990e4d74-6e7f-42f6-a003-c1a3e2f52449", "name": "network-vif-deleted", "tag": "2f546386-f9b9-44c0-8328-7aca5bef1800"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:20.421385 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-592ae45c-4450-4c53-9518-64aad3edb5a1 req-aaf905a6-9c60-4c12-a7da-4566ebe88532 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:20.421880 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-592ae45c-4450-4c53-9518-64aad3edb5a1 req-aaf905a6-9c60-4c12-a7da-4566ebe88532 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:20.422356 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-592ae45c-4450-4c53-9518-64aad3edb5a1 req-aaf905a6-9c60-4c12-a7da-4566ebe88532 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:20.434316 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-592ae45c-4450-4c53-9518-64aad3edb5a1 req-aaf905a6-9c60-4c12-a7da-4566ebe88532 service nova] Creating event network-vif-deleted:2f546386-f9b9-44c0-8328-7aca5bef1800 for instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 on hv-cinder-85164 Aug 24 17:39:20.440203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-592ae45c-4450-4c53-9518-64aad3edb5a1 req-aaf905a6-9c60-4c12-a7da-4566ebe88532 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035926 Aug 24 17:39:20.442559 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 642/1310] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:20.535060 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:20.535638 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:20.542072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:20.542648 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:20.543188 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:20.543986 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:20.545238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:20.545691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:20.561057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] HTTP exception thrown: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Request method failure captured: Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: DELETE /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 HTTP/1.1 Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8r0X6gglO-ZMlPwgkPYH9ImTSOa9mR-FRUbOaZ__3JqJ-iq3smlaDm9SC_IckWkebKWzvU2D8WwtSGf-PsIUnXR8ic9MZWul36ejPPnFI5cTDjy3TV00QF-FcDG1DeWEEr8Q3R0tVT_Ju7DCD0FmYrA9FnoP3uxX6VQ3BIIlqwnRw Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:39:20.562755 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15cff6e1349f4bb1a2905e6e5231fc2d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: c379c845fccd43c08e8699976d506801 Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.564447 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '127fd694-1843-4ba5-97aa-2565c01c30c2'} Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:20.565567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.567074 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.568635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Returning 404 to user: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:20.568635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-dea6b70d-0ad2-4714-beb4-561b23082400 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 404 len: 111 microversion: 2.20 time: 0.033543 Aug 24 17:39:20.568635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 669/1311] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 24 17:39:20 2022] DELETE /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:39:20.580683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:20.581406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 127fd694-1843-4ba5-97aa-2565c01c30c2] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:20.595235 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:20.595751 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:20.596193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:20.597340 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:20.597450 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:20.597870 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:20.613085 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] HTTP exception thrown: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Request method failure captured: Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 HTTP/1.1 Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8r0X6gglO-ZMlPwgkPYH9ImTSOa9mR-FRUbOaZ__3JqJ-iq3smlaDm9SC_IckWkebKWzvU2D8WwtSGf-PsIUnXR8ic9MZWul36ejPPnFI5cTDjy3TV00QF-FcDG1DeWEEr8Q3R0tVT_Ju7DCD0FmYrA9FnoP3uxX6VQ3BIIlqwnRw Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:39:20.614929 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15cff6e1349f4bb1a2905e6e5231fc2d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: c379c845fccd43c08e8699976d506801 Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.616522 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '127fd694-1843-4ba5-97aa-2565c01c30c2'} Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:20.617503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. Aug 24 17:39:20.618800 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:20.620114 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Returning 404 to user: Instance 127fd694-1843-4ba5-97aa-2565c01c30c2 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:20.620114 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6410faee-1ecd-486b-8d97-f9d9b04b4498 tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2" status: 404 len: 111 microversion: 2.20 time: 0.047090 Aug 24 17:39:20.620114 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 643/1312] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:39:20 2022] GET /compute/v2.1/servers/127fd694-1843-4ba5-97aa-2565c01c30c2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:39:21.205537 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:21.206080 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:21.212873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:21.213371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:21.213959 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:21.214613 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:21.215101 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:21.215535 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:21.253443 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:21.253957 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:21.254393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:21.258117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lazy-loading 'fault' on Instance uuid 990e4d74-6e7f-42f6-a003-c1a3e2f52449 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:39:21.304250 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47da700d7d0f4d5cb1ea984a82d643bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036fc4bf065249e29d0e1e90d23bae19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:21.312595 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1db8a34c-3fa9-4b63-96d3-3cc89a01b0f1 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 200 len: 1229 microversion: 2.1 time: 0.110859 Aug 24 17:39:21.314175 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 670/1313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:21 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:22.004440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:22.005024 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:22.012608 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.014474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.014474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.014474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.014773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.015248 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.030480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] HTTP exception thrown: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Request method failure captured: Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 HTTP/1.1 Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8r0X6gglO-ZMlPwgkPYH9ImTSOa9mR-FRUbOaZ__3JqJ-iq3smlaDm9SC_IckWkebKWzvU2D8WwtSGf-PsIUnXR8ic9MZWul36ejPPnFI5cTDjy3TV00QF-FcDG1DeWEEr8Q3R0tVT_Ju7DCD0FmYrA9FnoP3uxX6VQ3BIIlqwnRw Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:39:22.032339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15cff6e1349f4bb1a2905e6e5231fc2d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: c379c845fccd43c08e8699976d506801 Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.033965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '5542f65d-3efd-4dc6-9c28-ea9d8ac19317'} Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:22.034825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.036203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.037533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Returning 404 to user: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:22.037533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ad2afc82-824a-40e2-8bb1-245cc374f71a tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 404 len: 111 microversion: 2.20 time: 0.033449 Aug 24 17:39:22.037533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 644/1314] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Aug 24 17:39:21 2022] DELETE /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:39:22.042764 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:22.043683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] [instance: 5542f65d-3efd-4dc6-9c28-ea9d8ac19317] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:22.050870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.051460 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.051970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.052756 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.053280 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.053772 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.068536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] HTTP exception thrown: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Request method failure captured: Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 HTTP/1.1 Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8r0X6gglO-ZMlPwgkPYH9ImTSOa9mR-FRUbOaZ__3JqJ-iq3smlaDm9SC_IckWkebKWzvU2D8WwtSGf-PsIUnXR8ic9MZWul36ejPPnFI5cTDjy3TV00QF-FcDG1DeWEEr8Q3R0tVT_Ju7DCD0FmYrA9FnoP3uxX6VQ3BIIlqwnRw Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:39:22.070169 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15cff6e1349f4bb1a2905e6e5231fc2d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15cff6e1349f4bb1a2905e6e5231fc2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 15cff6e1349f4bb1a2905e6e5231fc2d Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-224031928 Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: c379c845fccd43c08e8699976d506801 Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeShelveTestJSON-224031928-project Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.072040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '5542f65d-3efd-4dc6-9c28-ea9d8ac19317'} Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:22.073033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. Aug 24 17:39:22.074438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.075797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] Returning 404 to user: Instance 5542f65d-3efd-4dc6-9c28-ea9d8ac19317 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:22.075797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b26a5abd-0291-45ab-875a-d8c969ba07dc tempest-AttachVolumeShelveTestJSON-224031928 tempest-AttachVolumeShelveTestJSON-224031928-project] 10.222.0.18 "GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317" status: 404 len: 111 microversion: 2.20 time: 0.033736 Aug 24 17:39:22.075797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 671/1315] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Aug 24 17:39:22 2022] GET /compute/v2.1/servers/5542f65d-3efd-4dc6-9c28-ea9d8ac19317 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:39:22.333838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:22.334461 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 990e4d74-6e7f-42f6-a003-c1a3e2f52449] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:22.340551 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.341033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.341471 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.342158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.342611 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.343064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.356752 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] HTTP exception thrown: Instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 could not be found. Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Request method failure captured: Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 HTTP/1.1 Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl-EL00gZv5DsF1U7Oj6KHwzWHaWOFjNU9U1pvzlzO8AEaiaDiUDx37iG_TuYtAufLjvxkrdXKUqhf-E55_crSILPBAQ1R1CkR9MACa60CoJx3TMOMqe8bPvE7oaQMcOK1Duupmw9y2vRRrM7ixD-JnWceE8ENh1HOcnUl4CHf_nRCk Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:39:22.360325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_036fc4bf065249e29d0e1e90d23bae19", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 47da700d7d0f4d5cb1ea984a82d643bf Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 could not be found. Aug 24 17:39:22.361963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '990e4d74-6e7f-42f6-a003-c1a3e2f52449'} Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 could not be found. Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:22.362980 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 could not be found. Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 could not be found. Aug 24 17:39:22.364501 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.366442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Returning 404 to user: Instance 990e4d74-6e7f-42f6-a003-c1a3e2f52449 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:22.366442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-59bb92d1-0235-4d2c-841d-3682fc77101c tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449" status: 404 len: 111 microversion: 2.1 time: 0.029932 Aug 24 17:39:22.366442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 645/1316] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:22 2022] GET /compute/v2.1/servers/990e4d74-6e7f-42f6-a003-c1a3e2f52449 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:39:22.927133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:22.928448 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:22.934399 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.935183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.935615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.936489 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.936934 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.937513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.952422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] HTTP exception thrown: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Request method failure captured: Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: DELETE /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 HTTP/1.1 Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl-EL00gZv5DsF1U7Oj6KHwzWHaWOFjNU9U1pvzlzO8AEaiaDiUDx37iG_TuYtAufLjvxkrdXKUqhf-E55_crSILPBAQ1R1CkR9MACa60CoJx3TMOMqe8bPvE7oaQMcOK1Duupmw9y2vRRrM7ixD-JnWceE8ENh1HOcnUl4CHf_nRCk Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:39:22.954224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_036fc4bf065249e29d0e1e90d23bae19", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 47da700d7d0f4d5cb1ea984a82d643bf Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:22.957866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '028a50e6-e905-4cc5-aaab-ad1dfe279845'} Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:22.958784 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:22.960240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:22.961653 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Returning 404 to user: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:22.961653 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-96b859a8-d1f6-46bb-988e-e0e0f62bc854 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "DELETE /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 404 len: 111 microversion: 2.1 time: 0.032723 Aug 24 17:39:22.961653 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 672/1317] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:39:22 2022] DELETE /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:39:22.972885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:22.973856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] [instance: 028a50e6-e905-4cc5-aaab-ad1dfe279845] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:22.985415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.985415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.985415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.985415 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:22.985830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:22.985830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:22.997794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] HTTP exception thrown: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Request method failure captured: Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 HTTP/1.1 Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl-EL00gZv5DsF1U7Oj6KHwzWHaWOFjNU9U1pvzlzO8AEaiaDiUDx37iG_TuYtAufLjvxkrdXKUqhf-E55_crSILPBAQ1R1CkR9MACa60CoJx3TMOMqe8bPvE7oaQMcOK1Duupmw9y2vRRrM7ixD-JnWceE8ENh1HOcnUl4CHf_nRCk Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:39:22.999384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_036fc4bf065249e29d0e1e90d23bae19", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/036fc4bf065249e29d0e1e90d23bae19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 036fc4bf065249e29d0e1e90d23bae19 Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestVolumeBootPattern-2105310568 Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 47da700d7d0f4d5cb1ea984a82d643bf Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-TestVolumeBootPattern-2105310568-project Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:23.000924 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '028a50e6-e905-4cc5-aaab-ad1dfe279845'} Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:23.001822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. Aug 24 17:39:23.003205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:23.004326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Returning 404 to user: Instance 028a50e6-e905-4cc5-aaab-ad1dfe279845 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:23.004326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2f386110-9adf-4af4-83be-3e3da2b04816 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845" status: 404 len: 111 microversion: 2.1 time: 0.035924 Aug 24 17:39:23.004326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 646/1318] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:22 2022] GET /compute/v2.1/servers/028a50e6-e905-4cc5-aaab-ad1dfe279845 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:39:24.738170 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9134f488-6676-49a1-a7c0-080dae0d4a96 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] Calling method '.version_select at 0x7f3f346bc8b0>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:24.823127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9134f488-6676-49a1-a7c0-080dae0d4a96 tempest-TestVolumeBootPattern-2105310568 tempest-TestVolumeBootPattern-2105310568-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-898876491" status: 202 len: 0 microversion: 2.1 time: 0.091845 Aug 24 17:39:24.824967 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 673/1319] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Aug 24 17:39:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-898876491 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:39:28.820183 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-998c43d6-a2ce-4fef-ad65-4a31cf663fc5 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Action: 'create', calling method: .version_select at 0x7f3f238c9280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-9284531"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:29.749419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-998c43d6-a2ce-4fef-ad65-4a31cf663fc5 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 342 microversion: 2.1 time: 1.091813 Aug 24 17:39:29.750013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 647/1320] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Aug 24 17:39:28 2022] POST /compute/v2.1/os-volumes => generated 342 bytes in 1094 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 17:39:29.766802 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0d21b26a-9e2b-439c-ba17-266705c478fd tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f3459c3a0>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:29.834837 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0d21b26a-9e2b-439c-ba17-266705c478fd tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8" status: 200 len: 342 microversion: 2.1 time: 0.075662 Aug 24 17:39:29.836099 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 674/1321] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:39:29 2022] GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 => generated 342 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:30.852734 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8e46a658-1b6a-4e59-9d7d-f2633fbcf29b tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f238e1700>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:30.909961 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8e46a658-1b6a-4e59-9d7d-f2633fbcf29b tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8" status: 200 len: 343 microversion: 2.1 time: 0.062526 Aug 24 17:39:30.910439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 648/1322] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:39:30 2022] GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 => generated 343 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:30.927178 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5f83bd82-f732-4198-9e9b-5e3d0829b7e1 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Action: 'create', calling method: .version_select at 0x7f3f3459c670>, body: {"snapshot": {"volume_id": "bb4291a2-6b0d-46d4-8bfd-8088b58f1df8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-446612779"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:31.477699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5f83bd82-f732-4198-9e9b-5e3d0829b7e1 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.558463 Aug 24 17:39:31.478456 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 675/1323] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Aug 24 17:39:30 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:31.490848 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a4711e5e-15a7-4591-8022-f7c0a4a3f95b tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f23e44670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:31.534174 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a4711e5e-15a7-4591-8022-f7c0a4a3f95b tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 200 len: 286 microversion: 2.1 time: 0.048331 Aug 24 17:39:31.534985 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 649/1324] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 24 17:39:31 2022] GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:31.545624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d2cbf65a-ad20-4a47-89e9-248a8890e206 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f346bc160>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:31.615130 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d2cbf65a-ad20-4a47-89e9-248a8890e206 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.073064 Aug 24 17:39:31.615930 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 676/1325] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Aug 24 17:39:31 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:31.627025 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dec540dc-3ef1-4e71-a2e5-e1f386ae82e2 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f23ec0430>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:31.662928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dec540dc-3ef1-4e71-a2e5-e1f386ae82e2 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 200 len: 286 microversion: 2.1 time: 0.039089 Aug 24 17:39:31.663796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 650/1326] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 24 17:39:31 2022] GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:39:32.676480 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a14cefa2-fc97-4ec5-bb32-4076e1f87ba5 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f30758a60>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:32.712044 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a14cefa2-fc97-4ec5-bb32-4076e1f87ba5 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 200 len: 286 microversion: 2.1 time: 0.039814 Aug 24 17:39:32.712866 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 677/1327] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 24 17:39:32 2022] GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:33.730408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ec559154-539b-465a-a668-51681d358933 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f34685ee0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:33.739900 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:33.752724 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:33.784207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ec559154-539b-465a-a668-51681d358933 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 200 len: 286 microversion: 2.1 time: 0.060339 Aug 24 17:39:33.790488 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 651/1328] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 24 17:39:33 2022] GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:34.796635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-655c3998-5dd7-4f35-bddd-38b1dd1ae81a tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f30936280>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:34.811992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:34.811992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:34.843204 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-655c3998-5dd7-4f35-bddd-38b1dd1ae81a tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 200 len: 286 microversion: 2.1 time: 0.050855 Aug 24 17:39:34.843777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 678/1329] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 24 17:39:34 2022] GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:39:35.856584 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5f22371d-70fe-49d8-abfa-1a1106d12fff tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f3014ae50>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:35.895200 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5f22371d-70fe-49d8-abfa-1a1106d12fff tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 200 len: 286 microversion: 2.1 time: 0.043281 Aug 24 17:39:35.896019 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 652/1330] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 24 17:39:35 2022] GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:36.890163 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:36.890878 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:36.898845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:36.899361 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:36.899803 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:36.900492 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:36.900950 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:36.901378 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:36.909705 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1d4392df-24a3-41a3-94cf-4a5e473256ff tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f23f78670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:36.927318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lazy-loading 'flavor' on Instance uuid 68a7e303-08e1-4970-a0c8-e30d82054b93 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:39:36.941421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1d4392df-24a3-41a3-94cf-4a5e473256ff tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 200 len: 287 microversion: 2.1 time: 0.036323 Aug 24 17:39:36.942031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 653/1331] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 24 17:39:36 2022] GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:36.954452 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e84faa2f-cd20-496e-9d61-95cd78123f2d tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f238e1af0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:37.067676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e84faa2f-cd20-496e-9d61-95cd78123f2d tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 202 len: 0 microversion: 2.1 time: 0.117079 Aug 24 17:39:37.068416 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 654/1332] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Aug 24 17:39:36 2022] DELETE /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:39:37.077433 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9d778a52-659e-4f30-bc8e-e25c0780bef6 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f23f78670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:37.117193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9d778a52-659e-4f30-bc8e-e25c0780bef6 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 200 len: 286 microversion: 2.1 time: 0.044284 Aug 24 17:39:37.122467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 655/1333] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 24 17:39:37 2022] GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:39:37.201904 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-50f15856-7205-492b-8fd9-d275b9b601a3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "POST /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93/action" status: 202 len: 0 microversion: 2.1 time: 0.314807 Aug 24 17:39:37.202654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 679/1334] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:39:36 2022] POST /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:39:37.211745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:37.212419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:37.219240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:37.219744 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:37.220192 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:37.220917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:37.221369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:37.221826 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:37.380257 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:37.390188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-22b9181f-cbf6-4a35-86e3-7ac2acf9a173 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.182345 Aug 24 17:39:37.390920 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 656/1335] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:37 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:38.131314 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ccbf2c04-bf6f-4cbf-8a69-122cded06c19 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f34677940>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:38.157634 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-ccbf2c04-bf6f-4cbf-8a69-122cded06c19 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] HTTP exception thrown: Snapshot 91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 could not be found. Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ccbf2c04-bf6f-4cbf-8a69-122cded06c19 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Request method failure captured: Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 HTTP/1.1 Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBmJQLOSwXj8_eIYAapefSeZ0b1Y1ygQVt_CJdUh3xNuvJS2aXssVP8VSFxHiNTwWoDGd5euckrrI2Z1nqUZOlv0hTeKWtz_NqxJdgCggRhw3ZZszqGkD1DadCe0RpoL2lu_PEKNEqCj3JEhAfj2Dczqfoah3yK1NXE6ChQIrWpGPeCw Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 727788f6028948f89d3ab8338e15ba09 Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:39:38.160051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_727788f6028948f89d3ab8338e15ba09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 727788f6028948f89d3ab8338e15ba09 Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-VolumesSnapshotsTestJSON-197265383-project Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 804436148e164d46a65373a1f1c9ed58 Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-VolumesSnapshotsTestJSON-197265383-project Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Snapshot 91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 could not be found. Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '91cb59f2-eb95-4689-a0a7-c4b4b0c581e8'} Aug 24 17:39:38.161624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 could not be found. (HTTP 404) (Request-ID: req-91d9f031-b493-4b96-a7f0-a95938292996) Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:38.162710 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:39:38.163915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 could not be found. Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 17:39:38.165769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 could not be found. Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 could not be found. Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ccbf2c04-bf6f-4cbf-8a69-122cded06c19 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Returning 404 to user: Snapshot 91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:38.167275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ccbf2c04-bf6f-4cbf-8a69-122cded06c19 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8" status: 404 len: 111 microversion: 2.1 time: 0.035490 Aug 24 17:39:38.168267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 680/1336] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Aug 24 17:39:38 2022] GET /compute/v2.1/os-snapshots/91cb59f2-eb95-4689-a0a7-c4b4b0c581e8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:39:38.170760 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a5171340-a134-4b20-8849-5ed613db7224 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f23f78040>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:38.411996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:38.413752 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:38.420304 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:38.420686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:38.421126 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:38.421946 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:38.422286 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:38.422720 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:38.468887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a5171340-a134-4b20-8849-5ed613db7224 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8" status: 202 len: 0 microversion: 2.1 time: 0.302476 Aug 24 17:39:38.469928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 657/1337] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:39:38 2022] DELETE /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:39:38.477822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-49fc7ca3-7e9e-43e8-9295-364c8db15351 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f238dcf70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:38.528465 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-49fc7ca3-7e9e-43e8-9295-364c8db15351 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8" status: 200 len: 342 microversion: 2.1 time: 0.054220 Aug 24 17:39:38.530511 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 658/1338] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:39:38 2022] GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 => generated 342 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:39:38.571097 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:38.581371 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9d9a486d-f096-4a0c-8091-ae7a8ccc6a96 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.173421 Aug 24 17:39:38.581973 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 681/1339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:38 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:39:39.546122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68ac09bb-252a-4529-a6df-dbf2aa82dbf5 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f30246670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:39.574576 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-68ac09bb-252a-4529-a6df-dbf2aa82dbf5 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] HTTP exception thrown: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68ac09bb-252a-4529-a6df-dbf2aa82dbf5 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Request method failure captured: Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 HTTP/1.1 Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBmJQLOSwXj8_eIYAapefSeZ0b1Y1ygQVt_CJdUh3xNuvJS2aXssVP8VSFxHiNTwWoDGd5euckrrI2Z1nqUZOlv0hTeKWtz_NqxJdgCggRhw3ZZszqGkD1DadCe0RpoL2lu_PEKNEqCj3JEhAfj2Dczqfoah3yK1NXE6ChQIrWpGPeCw Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 727788f6028948f89d3ab8338e15ba09 Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:39:39.587796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_727788f6028948f89d3ab8338e15ba09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 727788f6028948f89d3ab8338e15ba09 Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-VolumesSnapshotsTestJSON-197265383-project Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 804436148e164d46a65373a1f1c9ed58 Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-VolumesSnapshotsTestJSON-197265383-project Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'bb4291a2-6b0d-46d4-8bfd-8088b58f1df8'} Aug 24 17:39:39.589528 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. (HTTP 404) (Request-ID: req-0943f3f8-a164-4527-8db8-34af9280482c) Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:39.590674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:39:39.592852 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:39:39.594187 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-68ac09bb-252a-4529-a6df-dbf2aa82dbf5 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Returning 404 to user: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-68ac09bb-252a-4529-a6df-dbf2aa82dbf5 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8" status: 404 len: 109 microversion: 2.1 time: 0.049570 Aug 24 17:39:39.595487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 659/1340] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:39:39 2022] GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:39:39.605152 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:39.605800 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:39.613839 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:39.615120 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:39.615609 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ebeb196-6968-466b-85be-79d6f4d50f88 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f238c9f70>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:39.615955 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:39.617964 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:39.618660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:39.619270 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:39.645357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-6ebeb196-6968-466b-85be-79d6f4d50f88 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] HTTP exception thrown: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ebeb196-6968-466b-85be-79d6f4d50f88 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Request method failure captured: Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 HTTP/1.1 Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBmJQLOSwXj8_eIYAapefSeZ0b1Y1ygQVt_CJdUh3xNuvJS2aXssVP8VSFxHiNTwWoDGd5euckrrI2Z1nqUZOlv0hTeKWtz_NqxJdgCggRhw3ZZszqGkD1DadCe0RpoL2lu_PEKNEqCj3JEhAfj2Dczqfoah3yK1NXE6ChQIrWpGPeCw Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 727788f6028948f89d3ab8338e15ba09 Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:39:39.646665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_727788f6028948f89d3ab8338e15ba09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 727788f6028948f89d3ab8338e15ba09 Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-VolumesSnapshotsTestJSON-197265383-project Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 804436148e164d46a65373a1f1c9ed58 Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-VolumesSnapshotsTestJSON-197265383-project Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'bb4291a2-6b0d-46d4-8bfd-8088b58f1df8'} Aug 24 17:39:39.648299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. (HTTP 404) (Request-ID: req-46529ad8-f851-43e3-9279-9d6f95154161) Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:39.649675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:39:39.651225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:39:39.653252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6ebeb196-6968-466b-85be-79d6f4d50f88 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Returning 404 to user: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6ebeb196-6968-466b-85be-79d6f4d50f88 tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8" status: 404 len: 109 microversion: 2.1 time: 0.037573 Aug 24 17:39:39.656380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 660/1341] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:39:39 2022] DELETE /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:39:39.662086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc74b1cb-b537-4208-8e40-b1cfe659aadd tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Calling method '.version_select at 0x7f3f23f783a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:39.704888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-dc74b1cb-b537-4208-8e40-b1cfe659aadd tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] HTTP exception thrown: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc74b1cb-b537-4208-8e40-b1cfe659aadd tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Request method failure captured: Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 HTTP/1.1 Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBmJQLOSwXj8_eIYAapefSeZ0b1Y1ygQVt_CJdUh3xNuvJS2aXssVP8VSFxHiNTwWoDGd5euckrrI2Z1nqUZOlv0hTeKWtz_NqxJdgCggRhw3ZZszqGkD1DadCe0RpoL2lu_PEKNEqCj3JEhAfj2Dczqfoah3yK1NXE6ChQIrWpGPeCw Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 727788f6028948f89d3ab8338e15ba09 Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:39:39.706967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_727788f6028948f89d3ab8338e15ba09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/727788f6028948f89d3ab8338e15ba09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 727788f6028948f89d3ab8338e15ba09 Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-197265383 Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-VolumesSnapshotsTestJSON-197265383-project Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 804436148e164d46a65373a1f1c9ed58 Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-VolumesSnapshotsTestJSON-197265383-project Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'bb4291a2-6b0d-46d4-8bfd-8088b58f1df8'} Aug 24 17:39:39.711288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. (HTTP 404) (Request-ID: req-87072ad3-f882-4dec-9324-afc047c4445b) Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:39.712854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:39:39.714386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:39:39.715794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dc74b1cb-b537-4208-8e40-b1cfe659aadd tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] Returning 404 to user: Volume bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dc74b1cb-b537-4208-8e40-b1cfe659aadd tempest-VolumesSnapshotsTestJSON-197265383 tempest-VolumesSnapshotsTestJSON-197265383-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8" status: 404 len: 109 microversion: 2.1 time: 0.052437 Aug 24 17:39:39.717677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 661/1342] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:39:39 2022] GET /compute/v2.1/os-volumes/bb4291a2-6b0d-46d4-8bfd-8088b58f1df8 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:39:39.769778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:39.778133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-81934e5c-97e4-44d0-aa01-809aa7518005 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.177908 Aug 24 17:39:39.778849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 682/1343] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:39 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:39:40.800126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:40.802086 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:40.811150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:40.811634 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:40.812068 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:40.812954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:40.813758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:40.814365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:41.003630 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:41.012069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b674b8e6-777e-4058-aa3b-c4a580e441f9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.216370 Aug 24 17:39:41.012650 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 662/1344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:40 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:41.815580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f9f10f3d-a8c0-4570-ba15-7e584f6e39e7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:41.817043 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f9f10f3d-a8c0-4570-ba15-7e584f6e39e7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:41.826703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f10f3d-a8c0-4570-ba15-7e584f6e39e7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:41.827454 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f10f3d-a8c0-4570-ba15-7e584f6e39e7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:41.827977 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f10f3d-a8c0-4570-ba15-7e584f6e39e7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:41.828598 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f10f3d-a8c0-4570-ba15-7e584f6e39e7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:41.829244 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f10f3d-a8c0-4570-ba15-7e584f6e39e7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:41.829746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f9f10f3d-a8c0-4570-ba15-7e584f6e39e7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:41.855013 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f9f10f3d-a8c0-4570-ba15-7e584f6e39e7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/ips" status: 200 len: 148 microversion: 2.1 time: 0.043339 Aug 24 17:39:41.855602 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 683/1345] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:39:41 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:42.036660 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:42.037359 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:42.044224 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:42.048038 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:42.048038 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:42.048038 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:42.048038 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:42.048497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:42.213833 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:42.222575 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3a9ba18-2a4f-4f04-9f6c-fe0180584199 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.189889 Aug 24 17:39:42.223190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 663/1346] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:42 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:43.243722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:43.244426 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:43.251384 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:43.251875 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:43.252315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:43.253004 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:43.253482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:43.253870 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:43.394519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:43.403256 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bed22e58-086f-4ef9-ac23-90b8158bf21e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.163433 Aug 24 17:39:43.408195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 684/1347] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:43 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:44.425487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:44.426103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:44.432756 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:44.433260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:44.433674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:44.434361 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:44.434811 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:44.435336 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:44.574512 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:44.582937 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-9b8999ee-edeb-460c-aec7-648672865605 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.161337 Aug 24 17:39:44.583510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 664/1348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:44 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:44.748367 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2f40610c-596a-4d8f-9bcb-26f3fd9f863a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fe205e6-f4ee-401d-a984-4e1aa0b14923"}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:44.750797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2f40610c-596a-4d8f-9bcb-26f3fd9f863a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:44.758579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2f40610c-596a-4d8f-9bcb-26f3fd9f863a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:44.758579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2f40610c-596a-4d8f-9bcb-26f3fd9f863a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:44.758579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2f40610c-596a-4d8f-9bcb-26f3fd9f863a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:44.759134 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2f40610c-596a-4d8f-9bcb-26f3fd9f863a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:44.759317 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2f40610c-596a-4d8f-9bcb-26f3fd9f863a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:44.759671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2f40610c-596a-4d8f-9bcb-26f3fd9f863a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:45.604837 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:45.605591 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:45.614645 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2f40610c-596a-4d8f-9bcb-26f3fd9f863a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "POST /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870520 Aug 24 17:39:45.615422 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 685/1349] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:39:44 2022] POST /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments => generated 194 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:45.616677 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:45.617337 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:45.617786 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:45.618521 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:45.619059 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:45.619567 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:45.782928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:45.791205 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8f858f27-cbf0-4e0f-94e4-7b2dad5cfd8c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.190218 Aug 24 17:39:45.791757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 665/1350] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:45 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:39:46.814353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:46.815092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:46.821767 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:46.822271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:46.822729 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:46.823463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:46.823924 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:46.824355 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:46.958695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:46.967241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-13dadaf1-a150-4641-b1fa-060a16570a59 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.157661 Aug 24 17:39:46.967749 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 686/1351] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:46 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:47.988305 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:47.988923 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:47.995533 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:47.995967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:47.996425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:47.997125 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:47.997580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:47.998003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:48.130883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:48.139123 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d3c8ff11-bb11-4c6b-91d4-18796715c527 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.154238 Aug 24 17:39:48.139694 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 666/1352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:47 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:39:49.160291 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:49.160854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:49.167314 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:49.167811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:49.168263 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:49.168942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:49.169394 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:49.169815 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:49.319911 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:49.328099 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cd807a18-5f33-4b08-9da1-2b5cadff9bb1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.171741 Aug 24 17:39:49.328854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 687/1353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:49 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:50.349531 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:50.350122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:50.356913 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:50.357460 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:50.358055 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:50.359139 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:50.359598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:50.360030 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:50.500280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:50.508400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-db180199-67dd-4fa2-8cd6-5e1613f9a8a1 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.162799 Aug 24 17:39:50.509020 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 667/1354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:50 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:51.529615 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:51.531147 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:51.537902 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:51.538392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:51.538831 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:51.539560 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:51.540017 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:51.540443 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:51.698255 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:51.698482 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e10e1275-91b2-4e14-9219-d5fea841b6f7 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.172618 Aug 24 17:39:51.699193 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 688/1355] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:51 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:52.719957 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:52.720560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:52.727055 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:52.727544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:52.727975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:52.728686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:52.729138 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:52.729605 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:52.861111 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:52.869163 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2a762b0e-f7eb-4ed6-9127-9d0366ddd497 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.153103 Aug 24 17:39:52.869630 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 668/1356] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:52 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:53.891717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:53.893094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:53.901659 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:53.902474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:53.903180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:53.914571 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:53.915521 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:53.916122 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:54.095111 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:54.104909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1896e39b-6006-400c-a498-ef8ac08cd89a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.217598 Aug 24 17:39:54.120228 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 689/1357] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:53 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:55.127917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:55.129207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:55.135791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:55.136279 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:55.141696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:55.141696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:55.141696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:55.141696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:55.290299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:55.299410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-46a34e14-b2f8-4423-a574-80fc8cba6157 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.175080 Aug 24 17:39:55.300057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 669/1358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:55 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:56.336729 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:56.337151 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:56.344242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:56.344790 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:56.345232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:56.345937 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:56.346390 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:56.346817 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:56.520519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:56.530580 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-50ee7109-3968-4420-b435-bdaa6eb7586f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.197360 Aug 24 17:39:56.532375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 690/1359] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:56 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:57.553044 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:57.553720 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:57.560309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:57.560791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:57.561220 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:57.561908 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:57.562406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:57.563579 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:57.704382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:57.712592 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-7a8eea98-19fa-4389-8b5e-197e25bdb152 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.163477 Aug 24 17:39:57.713178 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 670/1360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:57 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:58.185911 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:58.186475 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:58.192724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:58.193207 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:58.193635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:58.195552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:58.195552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:58.195552 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:58.278620 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lazy-loading 'services' on Instance uuid ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:39:58.480047 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-8a02ae0e-24c1-4f93-b662-fdfaccc03a73 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments/0fe205e6-f4ee-401d-a984-4e1aa0b14923" status: 202 len: 0 microversion: 2.1 time: 0.297706 Aug 24 17:39:58.480545 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 691/1361] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:39:58 2022] DELETE /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments/0fe205e6-f4ee-401d-a984-4e1aa0b14923 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:39:58.494683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e3adbfea-e536-473f-b601-daa7175093f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:58.496902 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e3adbfea-e536-473f-b601-daa7175093f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:58.506143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3adbfea-e536-473f-b601-daa7175093f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:58.506777 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3adbfea-e536-473f-b601-daa7175093f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:58.507240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3adbfea-e536-473f-b601-daa7175093f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:58.507943 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3adbfea-e536-473f-b601-daa7175093f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:58.508565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3adbfea-e536-473f-b601-daa7175093f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:58.509294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e3adbfea-e536-473f-b601-daa7175093f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:58.554149 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e3adbfea-e536-473f-b601-daa7175093f7 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068321 Aug 24 17:39:58.555811 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 671/1362] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:39:58 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:58.736825 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:58.736825 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:58.742965 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:58.746656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:58.746656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:58.746656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:58.746656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:58.747791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:58.923106 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:58.926829 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:39:58.931686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f28bb2e6-db36-459d-81e9-3e215281a81b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1569 microversion: 2.1 time: 0.201388 Aug 24 17:39:58.932274 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 692/1363] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:58 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:58.952241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:39:58.952832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:58.960158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:58.960629 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:58.961061 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:58.961741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:58.962244 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:58.962649 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:58.994429 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121010) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:39:59.396548 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-77ce29b7-6ac6-47f1-83e9-ccce4ca705dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "POST /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93/action" status: 202 len: 0 microversion: 2.1 time: 0.448135 Aug 24 17:39:59.400975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 672/1364] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Aug 24 17:39:58 2022] POST /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:39:59.406431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:59.407163 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:59.417568 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:59.418067 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:59.418509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:59.419253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:59.419835 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:59.420457 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:59.569171 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-213b8a37-62b4-4c5a-b5c5-71628853337d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:59.571471 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-213b8a37-62b4-4c5a-b5c5-71628853337d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:39:59.577732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-213b8a37-62b4-4c5a-b5c5-71628853337d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:59.578299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-213b8a37-62b4-4c5a-b5c5-71628853337d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:59.578742 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-213b8a37-62b4-4c5a-b5c5-71628853337d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:59.579469 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-213b8a37-62b4-4c5a-b5c5-71628853337d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:59.579916 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-213b8a37-62b4-4c5a-b5c5-71628853337d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:59.580340 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-213b8a37-62b4-4c5a-b5c5-71628853337d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:59.587160 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:39:59.595209 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c3678ccb-1bb9-4cb0-a62b-b7aa0ef6fdab tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1577 microversion: 2.1 time: 0.193391 Aug 24 17:39:59.595878 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 693/1365] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:39:59 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:39:59.615609 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-213b8a37-62b4-4c5a-b5c5-71628853337d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051308 Aug 24 17:39:59.616197 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 673/1366] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:39:59 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:00.558415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-47166fb7-8031-4dd0-a427-139fcdfaa655 req-f78620f8-7f51-4798-99c2-1f575b32855a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a7e303-08e1-4970-a0c8-e30d82054b93", "name": "network-vif-unplugged", "status": "completed", "tag": "2b921a7d-2dbb-4c33-a5ee-bf04279355e3"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:00.570316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-47166fb7-8031-4dd0-a427-139fcdfaa655 req-f78620f8-7f51-4798-99c2-1f575b32855a service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:00.571051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-47166fb7-8031-4dd0-a427-139fcdfaa655 req-f78620f8-7f51-4798-99c2-1f575b32855a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:00.571793 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-47166fb7-8031-4dd0-a427-139fcdfaa655 req-f78620f8-7f51-4798-99c2-1f575b32855a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:00.598884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.compute.server_external_events [req-47166fb7-8031-4dd0-a427-139fcdfaa655 req-f78620f8-7f51-4798-99c2-1f575b32855a service nova] Unable to find a host for instance 68a7e303-08e1-4970-a0c8-e30d82054b93. Dropping event network-vif-unplugged {{(pid=121011) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 17:40:00.599793 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-47166fb7-8031-4dd0-a427-139fcdfaa655 req-f78620f8-7f51-4798-99c2-1f575b32855a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049044 Aug 24 17:40:00.600393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 694/1367] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 17:40:00.622896 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:00.623769 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:00.631701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:00.631876 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e13cbb17-a838-45ef-a45c-e9c21b277b27 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:00.632189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:00.632692 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:00.633453 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:00.634005 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:00.634315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e13cbb17-a838-45ef-a45c-e9c21b277b27 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:00.634561 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:00.641231 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13cbb17-a838-45ef-a45c-e9c21b277b27 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:00.641957 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13cbb17-a838-45ef-a45c-e9c21b277b27 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:00.642834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13cbb17-a838-45ef-a45c-e9c21b277b27 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:00.643757 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13cbb17-a838-45ef-a45c-e9c21b277b27 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:00.644389 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13cbb17-a838-45ef-a45c-e9c21b277b27 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:00.644994 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e13cbb17-a838-45ef-a45c-e9c21b277b27 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:00.722318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e13cbb17-a838-45ef-a45c-e9c21b277b27 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094802 Aug 24 17:40:00.723369 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 695/1368] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Aug 24 17:40:00 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:40:00.809273 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:00.809984 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:00.818000 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:00.818500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:00.818970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:00.819683 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:00.820327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:00.820962 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:00.873917 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:00.878500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:40:00.886064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d79229b-0a6b-43f6-8119-166d71fac2ad tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1517 microversion: 2.1 time: 0.266918 Aug 24 17:40:00.886619 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 674/1369] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:00 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:01.187595 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1e1a31b8-e076-46db-a8e8-27b6d902e411 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 204 len: 0 microversion: 2.1 time: 0.381873 Aug 24 17:40:01.188503 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 696/1370] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:40:00 2022] DELETE /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:40:01.196952 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:01.197680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:01.206804 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:01.207350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:01.207948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:01.208674 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:01.209128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:01.209553 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:01.352645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:01.359812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b5007ee9-9d9a-46c9-a937-da2c96ea5b96 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.166810 Aug 24 17:40:01.360406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 675/1371] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:01 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:01.908526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:01.909266 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:01.916177 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:01.916520 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:01.916960 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:01.917661 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:01.918115 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:01.918540 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:02.060945 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:02.071166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d2f5ba85-63a4-4a3b-9f6c-4ffeae27157b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1517 microversion: 2.1 time: 0.166925 Aug 24 17:40:02.072216 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 697/1372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:01 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:02.381938 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:02.382675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:02.389334 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:02.389857 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:02.390298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:02.391585 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:02.392036 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:02.392751 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:02.411322 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:02.535691 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:02.543518 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e15d3e12-db82-48d0-8588-c04d6e481647 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.165357 Aug 24 17:40:02.544112 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 676/1373] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:02 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:03.098343 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:03.099123 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:03.106144 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:03.106632 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:03.107125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:03.107821 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:03.108271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:03.108692 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:03.262287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:03.270637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-414012a8-5fb8-419e-9767-d578da2bc73c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1519 microversion: 2.1 time: 0.177001 Aug 24 17:40:03.271238 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 698/1374] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:03 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:03.565243 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:03.565963 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:03.573320 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:03.573910 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:03.574560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:03.575464 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:03.576097 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:03.576525 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:03.730102 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:03.739714 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1a044eb1-7e70-49a5-b9d1-56880067489d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.178836 Aug 24 17:40:03.742942 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 677/1375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:03 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:04.291719 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:04.292344 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:04.300393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:04.301180 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:04.301680 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:04.302400 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:04.302857 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:04.308011 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:04.439477 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1d10634d-8996-4d31-8c73-fa07844ab816 req-5906b23c-3f00-4c90-b3f0-13e463b35a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b", "name": "network-vif-deleted", "tag": "54ee51a3-c6d8-4bba-ade2-885300b52ffb"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:04.457240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1d10634d-8996-4d31-8c73-fa07844ab816 req-5906b23c-3f00-4c90-b3f0-13e463b35a10 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:04.457728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1d10634d-8996-4d31-8c73-fa07844ab816 req-5906b23c-3f00-4c90-b3f0-13e463b35a10 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:04.458162 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1d10634d-8996-4d31-8c73-fa07844ab816 req-5906b23c-3f00-4c90-b3f0-13e463b35a10 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:04.473255 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1d10634d-8996-4d31-8c73-fa07844ab816 req-5906b23c-3f00-4c90-b3f0-13e463b35a10 service nova] Creating event network-vif-deleted:54ee51a3-c6d8-4bba-ade2-885300b52ffb for instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b on hv-cinder-85164 Aug 24 17:40:04.478993 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1d10634d-8996-4d31-8c73-fa07844ab816 req-5906b23c-3f00-4c90-b3f0-13e463b35a10 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043730 Aug 24 17:40:04.480580 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 678/1376] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:40:04.541229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:04.552777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ae2115b2-1394-45c6-b352-34148ebe9798 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1519 microversion: 2.1 time: 0.262723 Aug 24 17:40:04.563582 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 699/1377] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:04 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:04.762225 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:04.762964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:04.770227 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:04.770722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:04.771195 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:04.772090 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:04.772550 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:04.772977 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:04.848434 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160ce86c89ea449da346d98d20ce2a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebea743b3843f3b6274ddfc0b5b73a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:04.857719 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0cd45212-e409-45bd-b7d4-f2246fad60aa tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 200 len: 1327 microversion: 2.1 time: 0.099740 Aug 24 17:40:04.858985 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 679/1378] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:04 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:05.573474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:05.576205 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:05.580353 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:05.580846 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:05.581315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:05.582018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:05.582469 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:05.582916 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:05.819512 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:05.827707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f92e5606-8231-4c23-9a2b-8988fa6bcdf4 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.258560 Aug 24 17:40:05.844310 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 700/1379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:05 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:05.878617 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:05.879299 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:05.885632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:05.886117 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:05.887715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:05.888449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:05.888905 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:05.889389 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:05.906077 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b HTTP/1.1 Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:40:05.908287 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:05.909895 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b'} Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:05.910701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:05.912130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:05.913365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:05.913365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-5cf7cbfa-3e3f-4f96-a0d0-ab41af6ecc66 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 404 len: 111 microversion: 2.1 time: 0.036022 Aug 24 17:40:05.913365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 680/1380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:05 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:05.918783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-41329c7e-cff7-4c8f-bb2e-ba13256d8a2a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '.version_select at 0x7f3f30758c10>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:06.013711 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-41329c7e-cff7-4c8f-bb2e-ba13256d8a2a tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930901264" status: 202 len: 0 microversion: 2.1 time: 0.098749 Aug 24 17:40:06.014408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 701/1381] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Aug 24 17:40:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930901264 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:40:06.849572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:06.850397 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:06.856482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:06.856962 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:06.857391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:06.858176 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:06.858662 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:06.862892 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:06.999390 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:07.007474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e503b45a-cfde-4f85-afce-9764df47a164 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.161867 Aug 24 17:40:07.008057 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 681/1382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:06 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:08.028953 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:08.029579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:08.036434 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:08.036940 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:08.041379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:08.041379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:08.041379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:08.041379 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:08.107871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:08.108449 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:08.110794 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:08.115786 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:08.116278 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:08.116717 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:08.117417 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:08.117869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:08.118293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:08.132443 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: DELETE /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b HTTP/1.1 Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:40:08.134016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.135683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b'} Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:08.136510 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.137745 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.139188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:08.139188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-48cdda08-465e-48b5-8e6f-f69e9e872b1b tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 404 len: 111 microversion: 2.1 time: 0.031451 Aug 24 17:40:08.139188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 682/1383] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:40:08 2022] DELETE /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:40:08.145126 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:08.145743 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:08.151778 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:08.156741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:08.156741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:08.156741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:08.156741 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:08.157106 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:08.171444 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b HTTP/1.1 Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:40:08.173041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.181406 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b'} Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:08.182832 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. Aug 24 17:40:08.184240 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:08.186884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:08.186884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-47bcb581-87e6-4502-bee6-bcbbd3e47510 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b" status: 404 len: 111 microversion: 2.1 time: 0.034224 Aug 24 17:40:08.186884 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 683/1384] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:08 2022] GET /compute/v2.1/servers/ecd3a29b-1437-4cd7-9ef3-8c4e8482ef2b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:08.189199 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:08.190200 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-448531af-aeb5-43c4-9b66-40486b769b12 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.165826 Aug 24 17:40:08.194992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 702/1385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:08 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:09.213382 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:09.214041 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:09.221648 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.222130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.222569 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.223291 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.223747 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.224173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.362412 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:09.370332 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f7e6327-d973-463a-8345-3e71d2480756 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.160769 Aug 24 17:40:09.370928 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 684/1386] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:09 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:09.491044 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:09.491666 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:09.497251 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:09.506877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.507413 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.507856 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.510989 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.510989 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.510989 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.523791 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: DELETE /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf HTTP/1.1 Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:40:09.525466 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.526854 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': 'e9f9ac6a-3c93-4196-826d-9e1f7adb52bf'} Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:09.527838 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.529463 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.532535 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:09.532535 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d65c249a-9bbd-4e4c-ab3f-ab8577501870 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 404 len: 111 microversion: 2.1 time: 0.039946 Aug 24 17:40:09.532535 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 703/1387] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:40:09 2022] DELETE /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:09.536360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:09.536984 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: e9f9ac6a-3c93-4196-826d-9e1f7adb52bf] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:09.543002 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.543493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.543936 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.544629 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.545119 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.545548 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.559575 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf HTTP/1.1 Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:40:09.561175 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.562871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': 'e9f9ac6a-3c93-4196-826d-9e1f7adb52bf'} Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:09.563823 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. Aug 24 17:40:09.565306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.566628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance e9f9ac6a-3c93-4196-826d-9e1f7adb52bf could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:09.566628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4a46f33e-7c1d-449a-be96-cb8c9ce8bc5d tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf" status: 404 len: 111 microversion: 2.1 time: 0.030002 Aug 24 17:40:09.566628 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 685/1388] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:09 2022] GET /compute/v2.1/servers/e9f9ac6a-3c93-4196-826d-9e1f7adb52bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:40:09.571697 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:09.572203 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:09.578973 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.579470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.579910 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.580645 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.581066 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.581493 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.596744 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: DELETE /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 HTTP/1.1 Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:40:09.598315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.599970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '86633f37-ebff-41dd-b6e6-2ece18437ab1'} Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:09.600841 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.602092 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.603500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:09.603500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4cea53a5-5486-46b7-adc5-a580fe1eeff9 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 404 len: 111 microversion: 2.1 time: 0.032262 Aug 24 17:40:09.603500 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 704/1389] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:40:09 2022] DELETE /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:09.608364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:09.609007 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 86633f37-ebff-41dd-b6e6-2ece18437ab1] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:09.615172 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.615698 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.616128 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.616808 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:09.617257 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:09.617678 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:09.631036 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 HTTP/1.1 Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:40:09.632586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.634206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '86633f37-ebff-41dd-b6e6-2ece18437ab1'} Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:09.635156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. Aug 24 17:40:09.636610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:09.638099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance 86633f37-ebff-41dd-b6e6-2ece18437ab1 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:09.638099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-e60d6569-d247-466f-a76b-cd46d5744326 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1" status: 404 len: 111 microversion: 2.1 time: 0.029491 Aug 24 17:40:09.638099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 686/1390] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:09 2022] GET /compute/v2.1/servers/86633f37-ebff-41dd-b6e6-2ece18437ab1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:10.391879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:10.392498 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:10.399398 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:10.407801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:10.407801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:10.407801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:10.407801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:10.408243 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:10.539175 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:10.548192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1469fc48-5f76-4f90-a7ee-88647b97accc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.160758 Aug 24 17:40:10.548859 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 705/1391] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:10 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:11.569725 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:11.570386 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:11.577031 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:11.577517 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:11.577951 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:11.578647 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:11.579136 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:11.579558 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:11.717898 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:11.725582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f6db739f-0dcc-4c62-bd48-09fa472ade7f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.159839 Aug 24 17:40:11.726143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 687/1392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:11 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:12.747695 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:12.748323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:12.755493 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:12.756028 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:12.756461 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:12.757137 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:12.757588 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:12.758006 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:12.886833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:12.895409 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-48d1ce39-c13b-4718-b92d-82828c621aff tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.151551 Aug 24 17:40:12.895977 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 706/1393] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:12 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:13.916251 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:13.916873 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:13.923894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:13.924410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:13.924883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:13.925573 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:13.926024 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:13.926446 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:14.062425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:14.070561 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-74ee5776-33a6-45c1-9948-a5815c701548 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.158156 Aug 24 17:40:14.071122 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 688/1394] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:13 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:14.096877 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:14.097490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:14.103873 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:14.104386 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:14.104844 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:14.105542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:14.106001 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:14.106420 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:14.125935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: DELETE /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e HTTP/1.1 Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:40:14.127519 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.129451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '95b97103-4f8f-4e11-aadd-a589dac7490e'} Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:14.131116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.134029 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.136649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:14.136649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2fd0b168-80a1-459b-b7b8-feed1f6b231e tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 404 len: 111 microversion: 2.1 time: 0.037262 Aug 24 17:40:14.136649 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 707/1395] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:40:14 2022] DELETE /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:14.137607 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:14.138206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] [instance: 95b97103-4f8f-4e11-aadd-a589dac7490e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:14.144803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:14.145288 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:14.145721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:14.146413 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:14.146866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:14.147301 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:14.161814 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] HTTP exception thrown: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Request method failure captured: Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e HTTP/1.1 Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBl8sRLsH7PHQ2FEwrArASmIrtiADY4J5LNSUhdd92QcGiqG0C8GQmGy19PEdXd-G9sqo2aQLD8NyC5BYHlqHsO28shbfC1pgDH8ByWzTABtve08eRisv17r1fgADUpb2GOXoUatRRY2mIepssm3WBgmq3_ryjW8pNvNDsexCq7VC5D0 Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:40:14.163476 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6ebea743b3843f3b6274ddfc0b5b73a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6ebea743b3843f3b6274ddfc0b5b73a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f6ebea743b3843f3b6274ddfc0b5b73a Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-487598219 Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 160ce86c89ea449da346d98d20ce2a9e Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-AttachVolumeNegativeTest-487598219-project Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.165132 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '95b97103-4f8f-4e11-aadd-a589dac7490e'} Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:14.166214 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. Aug 24 17:40:14.173252 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:14.174972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] Returning 404 to user: Instance 95b97103-4f8f-4e11-aadd-a589dac7490e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:14.174972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-f0f66ebe-8895-4b58-941a-166ab583e251 tempest-AttachVolumeNegativeTest-487598219 tempest-AttachVolumeNegativeTest-487598219-project] 10.222.0.18 "GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e" status: 404 len: 111 microversion: 2.1 time: 0.031067 Aug 24 17:40:14.174972 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 689/1396] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:14 2022] GET /compute/v2.1/servers/95b97103-4f8f-4e11-aadd-a589dac7490e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:40:15.091985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:15.092597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:15.099137 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:15.106961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:15.106961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:15.106961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:15.106961 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:15.107361 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:15.538055 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:15.546326 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bf626677-d56f-47fe-8f1b-49fb5c3bda51 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.458219 Aug 24 17:40:15.555367 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 708/1397] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:15 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:16.569084 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:16.573150 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:16.577354 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:16.578680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:16.579155 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:16.579871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:16.584216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:16.584216 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:16.741639 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:16.749734 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-2bbb0f02-ede0-49d6-ac45-04a65dee412c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.184667 Aug 24 17:40:16.750376 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 690/1398] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:16 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:17.772109 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:17.773766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:17.786361 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:17.787811 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:17.788319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:17.789271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:17.789801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:17.790306 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:17.963276 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:17.971957 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-91fec608-da94-4444-a852-467cd92ca132 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.203701 Aug 24 17:40:17.972538 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 709/1399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:17 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:18.993851 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:18.994477 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:19.003586 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:19.004072 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:19.004508 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:19.005215 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:19.005671 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:19.006304 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:19.155761 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:19.164473 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-13b84238-0866-457f-acab-153e039b655f tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.175396 Aug 24 17:40:19.165042 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 691/1400] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:18 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:20.185531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:20.186995 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:20.194633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:20.195148 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:20.195582 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:20.196307 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:20.196754 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:20.197175 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:20.349606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:20.358008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-aa5e9ce0-6fbd-4977-8641-6dcc2cdb53ba tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.176425 Aug 24 17:40:20.358592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 710/1401] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:20 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:21.379954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:21.380582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:21.387192 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:21.387682 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:21.388119 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:21.388964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:21.389427 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:21.389858 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:21.505095 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-602894ea-b768-4144-83c0-a2bf7dacc2d6 req-ada75928-9d30-4a89-969e-6ac9aab75cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a7e303-08e1-4970-a0c8-e30d82054b93", "name": "network-vif-plugged", "status": "completed", "tag": "2b921a7d-2dbb-4c33-a5ee-bf04279355e3"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:21.516489 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-602894ea-b768-4144-83c0-a2bf7dacc2d6 req-ada75928-9d30-4a89-969e-6ac9aab75cef service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:21.516980 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-602894ea-b768-4144-83c0-a2bf7dacc2d6 req-ada75928-9d30-4a89-969e-6ac9aab75cef service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:21.517415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-602894ea-b768-4144-83c0-a2bf7dacc2d6 req-ada75928-9d30-4a89-969e-6ac9aab75cef service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:21.529183 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-602894ea-b768-4144-83c0-a2bf7dacc2d6 req-ada75928-9d30-4a89-969e-6ac9aab75cef service nova] Creating event network-vif-plugged:2b921a7d-2dbb-4c33-a5ee-bf04279355e3 for instance 68a7e303-08e1-4970-a0c8-e30d82054b93 on hv-cinder-85164 Aug 24 17:40:21.535312 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-602894ea-b768-4144-83c0-a2bf7dacc2d6 req-ada75928-9d30-4a89-969e-6ac9aab75cef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034732 Aug 24 17:40:21.536374 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 711/1402] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:21.540505 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:21.548894 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-235dc101-ac57-4700-9dc2-36b1517901b0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.172885 Aug 24 17:40:21.549487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 692/1403] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:21 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:22.030044 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-ae7ebec9-f717-4ec5-906d-26e5cc6f97ac tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f344f4940>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:22.081468 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-ae7ebec9-f717-4ec5-906d-26e5cc6f97ac tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b3eb32d2-6873-43aa-8aa0-d187a93bcd8e" status: 200 len: 351 microversion: 2.1 time: 0.055524 Aug 24 17:40:22.082224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 712/1404] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:22 2022] GET /compute/v2.1/os-volumes/b3eb32d2-6873-43aa-8aa0-d187a93bcd8e => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:22.570780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:22.571422 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:22.578992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:22.579483 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:22.579919 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:22.580618 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:22.581075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:22.581493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:22.736319 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:22.744657 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1b5d225d-8eea-4991-9f87-1f6e4a6f090a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1575 microversion: 2.1 time: 0.177812 Aug 24 17:40:22.745262 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 693/1405] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:22 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:23.944969 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:23.945664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:23.953030 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:23.953740 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:23.954181 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:23.955053 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:23.955510 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:23.955935 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:23.959985 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:24.088804 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:24.098077 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-94e4d806-1995-4942-b0c7-a5c79575522a tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1562 microversion: 2.1 time: 0.335395 Aug 24 17:40:24.098743 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 713/1406] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:23 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1562 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:24.792869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a172a613-87b5-4b88-b3a2-9e67abc28e1d tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f23f773a0>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:24.838791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a172a613-87b5-4b88-b3a2-9e67abc28e1d tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b13e5828-db9e-40c2-97e6-7a8aa77a5715" status: 200 len: 350 microversion: 2.1 time: 0.049599 Aug 24 17:40:24.839467 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 694/1407] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:24 2022] GET /compute/v2.1/os-volumes/b13e5828-db9e-40c2-97e6-7a8aa77a5715 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:26.488036 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f6e6e1d5-0fbf-414f-b544-4196afd8a97c tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f3078e5e0>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:26.535540 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f6e6e1d5-0fbf-414f-b544-4196afd8a97c tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5042633d-afea-4584-b218-ec7defa8a0d0" status: 200 len: 350 microversion: 2.1 time: 0.051964 Aug 24 17:40:26.536110 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 714/1408] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:26 2022] GET /compute/v2.1/os-volumes/5042633d-afea-4584-b218-ec7defa8a0d0 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:26.549539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-69e5a5ab-13ca-4452-bbd9-7946ca5bd51c tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f2389f550>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:26.634816 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-69e5a5ab-13ca-4452-bbd9-7946ca5bd51c tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090062 Aug 24 17:40:26.635432 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 695/1409] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Aug 24 17:40:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:26.649797 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-120aeaa0-3e75-4d22-be53-232d6273b4c2 tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f346c41f0>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:26.735820 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-120aeaa0-3e75-4d22-be53-232d6273b4c2 tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089985 Aug 24 17:40:26.736388 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 715/1410] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Aug 24 17:40:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:26.750321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0eea366d-3d08-4d00-94e5-401317279618 tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f2389fc10>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:26.832838 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0eea366d-3d08-4d00-94e5-401317279618 tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086230 Aug 24 17:40:26.833419 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 696/1411] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Aug 24 17:40:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:40:26.846970 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-69da9115-0193-41ad-bbfd-f134e59ce648 tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f30936280>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:26.930418 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-69da9115-0193-41ad-bbfd-f134e59ce648 tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087969 Aug 24 17:40:26.931021 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 716/1412] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Aug 24 17:40:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:26.944437 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-ae2fe3dc-c8a4-410c-97b5-1f61407ae06e tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f238a0700>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:27.027351 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-ae2fe3dc-c8a4-410c-97b5-1f61407ae06e tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086579 Aug 24 17:40:27.027922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 697/1413] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Aug 24 17:40:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:27.041219 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-49cb7c19-cb85-4990-92b2-521a1a427f1d tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f3459e8b0>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:27.123561 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-49cb7c19-cb85-4990-92b2-521a1a427f1d tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085952 Aug 24 17:40:27.124137 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 717/1414] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Aug 24 17:40:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:27.137380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-625528ed-4ef5-4649-a6e3-91a42b3ba18c tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f238ab550>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:27.224436 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-625528ed-4ef5-4649-a6e3-91a42b3ba18c tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090625 Aug 24 17:40:27.225138 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 698/1415] 10.222.0.18 () {58 vars in 1188 bytes} [Wed Aug 24 17:40:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:27.238506 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-2248ca4f-05bd-424b-80fc-7e600b92a01b tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] Calling method '.version_select at 0x7f3f3078eca0>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:27.331923 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-2248ca4f-05bd-424b-80fc-7e600b92a01b tempest-VolumesTestJSON-802034384 tempest-VolumesTestJSON-802034384-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097700 Aug 24 17:40:27.332671 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 718/1416] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Aug 24 17:40:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:35.351060 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=23 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:35.352179 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=76 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:35.485068 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3cd8e93d-03fd-425d-a366-c8756d81f3bc tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Action: 'create', calling method: .version_select at 0x7f3f23f77940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1342946580", "metadata": {"Type": "work"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3cd8e93d-03fd-425d-a366-c8756d81f3bc tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Request method failure captured: Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 122 Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBmKTAOcaJ-lAh6LskGRuUUCkdKv89F94k_D_0E0PpbFvQdXXzpFSd72GJlMSI7T5rQmpRg1UVauS2v22avUV4Y2BJmVFWZSAn-H4LrAW8WITiTQjd6z6M1wfqVBWDj-2OwV4xu9KECaMmh4v3tIjJ9ssRRK0OmEeeSViK0sLl392AYc Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:40:35.500994 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f410101afcc246fa830d5661443fe628", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f410101afcc246fa830d5661443fe628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 34f0fc242a1c46ac8017b113df3f7e60 Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1342946580", "metadata": {"Type": "work"}}} Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: Aug 24 17:40:35.502875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1342946580', 'metadata': {'Type': 'work'}}}} Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:35.504092 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:40:35.505865 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:40:35.508470 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:40:35.508470 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.508470 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3cd8e93d-03fd-425d-a366-c8756d81f3bc tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:35.508470 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3cd8e93d-03fd-425d-a366-c8756d81f3bc tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.152736 Aug 24 17:40:35.508470 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 699/1417] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 24 17:40:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:40:35.513663 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=19 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:35.518267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9498ef98-ba6b-4647-a212-cce8230130ca tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Action: 'create', calling method: .version_select at 0x7f3f344ff820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1410311849", "metadata": {"Type": "work"}}} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9498ef98-ba6b-4647-a212-cce8230130ca tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Request method failure captured: Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 120 Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBmKTAOcaJ-lAh6LskGRuUUCkdKv89F94k_D_0E0PpbFvQdXXzpFSd72GJlMSI7T5rQmpRg1UVauS2v22avUV4Y2BJmVFWZSAn-H4LrAW8WITiTQjd6z6M1wfqVBWDj-2OwV4xu9KECaMmh4v3tIjJ9ssRRK0OmEeeSViK0sLl392AYc Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:40:35.523513 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f410101afcc246fa830d5661443fe628", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f410101afcc246fa830d5661443fe628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 34f0fc242a1c46ac8017b113df3f7e60 Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1410311849", "metadata": {"Type": "work"}}} Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: Aug 24 17:40:35.525290 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1410311849', 'metadata': {'Type': 'work'}}}} Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi '0' Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:35.526319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:40:35.528159 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:40:35.529886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:40:35.529886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.529886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9498ef98-ba6b-4647-a212-cce8230130ca tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:35.529886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9498ef98-ba6b-4647-a212-cce8230130ca tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012589 Aug 24 17:40:35.529886 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 719/1418] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 24 17:40:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:40:35.535181 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10b1a937-4a18-4084-8d06-9c6facfd4647 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Action: 'create', calling method: .version_select at 0x7f3f2386c0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2017256390", "metadata": {"Type": "work"}}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10b1a937-4a18-4084-8d06-9c6facfd4647 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Request method failure captured: Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 119 Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBmKTAOcaJ-lAh6LskGRuUUCkdKv89F94k_D_0E0PpbFvQdXXzpFSd72GJlMSI7T5rQmpRg1UVauS2v22avUV4Y2BJmVFWZSAn-H4LrAW8WITiTQjd6z6M1wfqVBWDj-2OwV4xu9KECaMmh4v3tIjJ9ssRRK0OmEeeSViK0sLl392AYc Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:40:35.539170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f410101afcc246fa830d5661443fe628", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f410101afcc246fa830d5661443fe628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 34f0fc242a1c46ac8017b113df3f7e60 Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2017256390", "metadata": {"Type": "work"}}} Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: Aug 24 17:40:35.540922 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2017256390', 'metadata': {'Type': 'work'}}}} Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi '' Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:35.543360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:40:35.545882 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:40:35.549834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:40:35.549834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.549834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-10b1a937-4a18-4084-8d06-9c6facfd4647 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:35.549834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-10b1a937-4a18-4084-8d06-9c6facfd4647 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010015 Aug 24 17:40:35.549834 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 700/1419] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Aug 24 17:40:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:40:35.557253 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0eca107b-fe77-4308-b73e-a08927bbceb2 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Calling method '.version_select at 0x7f3f346c4b80>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:35.584717 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-0eca107b-fe77-4308-b73e-a08927bbceb2 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] HTTP exception thrown: Volume tempest-invalid-1186196116 could not be found. Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0eca107b-fe77-4308-b73e-a08927bbceb2 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Request method failure captured: Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1186196116 HTTP/1.1 Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBmKTAOcaJ-lAh6LskGRuUUCkdKv89F94k_D_0E0PpbFvQdXXzpFSd72GJlMSI7T5rQmpRg1UVauS2v22avUV4Y2BJmVFWZSAn-H4LrAW8WITiTQjd6z6M1wfqVBWDj-2OwV4xu9KECaMmh4v3tIjJ9ssRRK0OmEeeSViK0sLl392AYc Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:40:35.586681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f410101afcc246fa830d5661443fe628", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f410101afcc246fa830d5661443fe628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 34f0fc242a1c46ac8017b113df3f7e60 Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Volume tempest-invalid-1186196116 could not be found. Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': 'tempest-invalid-1186196116'} Aug 24 17:40:35.594232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1186196116 could not be found. (HTTP 404) (Request-ID: req-a2c63a23-f59c-4e0c-9c99-099d73177a2a) Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.595321 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:35.596982 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1186196116 could not be found. Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:35.598509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1186196116 could not be found. Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1186196116 could not be found. Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0eca107b-fe77-4308-b73e-a08927bbceb2 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Returning 404 to user: Volume tempest-invalid-1186196116 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0eca107b-fe77-4308-b73e-a08927bbceb2 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1186196116" status: 404 len: 99 microversion: 2.1 time: 0.038782 Aug 24 17:40:35.603698 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 720/1420] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Aug 24 17:40:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1186196116 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:40:35.604716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-83e41ab7-1624-4f92-bb7b-679f6bb0d101 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003866 Aug 24 17:40:35.604716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 701/1421] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Aug 24 17:40:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 17:40:35.611345 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-eddb8b00-4f9b-4a8a-b298-0a1fbec428d9 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007237 Aug 24 17:40:35.612032 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 721/1422] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Aug 24 17:40:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 17:40:35.625207 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-be220355-a16d-4a22-8204-744dc0b0ab24 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Calling method '.version_select at 0x7f3f23ee6670>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:35.654170 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-be220355-a16d-4a22-8204-744dc0b0ab24 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] HTTP exception thrown: Volume 0e1b5d83-c172-4469-8188-03f699fc4bd3 could not be found. Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-be220355-a16d-4a22-8204-744dc0b0ab24 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Request method failure captured: Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: DELETE /compute/v2.1/os-volumes/0e1b5d83-c172-4469-8188-03f699fc4bd3 HTTP/1.1 Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBmKTAOcaJ-lAh6LskGRuUUCkdKv89F94k_D_0E0PpbFvQdXXzpFSd72GJlMSI7T5rQmpRg1UVauS2v22avUV4Y2BJmVFWZSAn-H4LrAW8WITiTQjd6z6M1wfqVBWDj-2OwV4xu9KECaMmh4v3tIjJ9ssRRK0OmEeeSViK0sLl392AYc Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:40:35.657115 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f410101afcc246fa830d5661443fe628", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f410101afcc246fa830d5661443fe628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 34f0fc242a1c46ac8017b113df3f7e60 Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Volume 0e1b5d83-c172-4469-8188-03f699fc4bd3 could not be found. Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '0e1b5d83-c172-4469-8188-03f699fc4bd3'} Aug 24 17:40:35.659366 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0e1b5d83-c172-4469-8188-03f699fc4bd3 could not be found. (HTTP 404) (Request-ID: req-5856dc3a-6476-4d38-9fdf-63a2f306ddb8) Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.660716 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:40:35.662442 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0e1b5d83-c172-4469-8188-03f699fc4bd3 could not be found. Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:40:35.664773 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0e1b5d83-c172-4469-8188-03f699fc4bd3 could not be found. Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0e1b5d83-c172-4469-8188-03f699fc4bd3 could not be found. Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-be220355-a16d-4a22-8204-744dc0b0ab24 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Returning 404 to user: Volume 0e1b5d83-c172-4469-8188-03f699fc4bd3 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-be220355-a16d-4a22-8204-744dc0b0ab24 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/0e1b5d83-c172-4469-8188-03f699fc4bd3" status: 404 len: 109 microversion: 2.1 time: 0.038014 Aug 24 17:40:35.666759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 702/1423] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Aug 24 17:40:35 2022] DELETE /compute/v2.1/os-volumes/0e1b5d83-c172-4469-8188-03f699fc4bd3 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:40:35.668288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-459b09a1-9701-4d4d-9d28-8e05cd9a3366 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Calling method '.version_select at 0x7f3f346cfee0>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:35.696413 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-459b09a1-9701-4d4d-9d28-8e05cd9a3366 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] HTTP exception thrown: Volume 2653f8e0-896d-41f2-9efd-29debac2f5d0 could not be found. Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-459b09a1-9701-4d4d-9d28-8e05cd9a3366 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Request method failure captured: Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/os-volumes/2653f8e0-896d-41f2-9efd-29debac2f5d0 HTTP/1.1 Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBmKTAOcaJ-lAh6LskGRuUUCkdKv89F94k_D_0E0PpbFvQdXXzpFSd72GJlMSI7T5rQmpRg1UVauS2v22avUV4Y2BJmVFWZSAn-H4LrAW8WITiTQjd6z6M1wfqVBWDj-2OwV4xu9KECaMmh4v3tIjJ9ssRRK0OmEeeSViK0sLl392AYc Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:40:35.698393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f410101afcc246fa830d5661443fe628"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f410101afcc246fa830d5661443fe628", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f410101afcc246fa830d5661443fe628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: f410101afcc246fa830d5661443fe628 Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-VolumesNegativeTest-2086040186 Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: 34f0fc242a1c46ac8017b113df3f7e60 Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-VolumesNegativeTest-2086040186-project Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Volume 2653f8e0-896d-41f2-9efd-29debac2f5d0 could not be found. Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '2653f8e0-896d-41f2-9efd-29debac2f5d0'} Aug 24 17:40:35.704438 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2653f8e0-896d-41f2-9efd-29debac2f5d0 could not be found. (HTTP 404) (Request-ID: req-497204c9-bf51-4388-b6ce-986fdb63c4e5) Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.705738 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:40:35.707708 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2653f8e0-896d-41f2-9efd-29debac2f5d0 could not be found. Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:40:35.709809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2653f8e0-896d-41f2-9efd-29debac2f5d0 could not be found. Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2653f8e0-896d-41f2-9efd-29debac2f5d0 could not be found. Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-459b09a1-9701-4d4d-9d28-8e05cd9a3366 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] Returning 404 to user: Volume 2653f8e0-896d-41f2-9efd-29debac2f5d0 could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-459b09a1-9701-4d4d-9d28-8e05cd9a3366 tempest-VolumesNegativeTest-2086040186 tempest-VolumesNegativeTest-2086040186-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2653f8e0-896d-41f2-9efd-29debac2f5d0" status: 404 len: 109 microversion: 2.1 time: 0.035522 Aug 24 17:40:35.711794 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 722/1424] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Aug 24 17:40:35 2022] GET /compute/v2.1/os-volumes/2653f8e0-896d-41f2-9efd-29debac2f5d0 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:40:42.036954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1426592434", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "networks": [{"uuid": "73901e32-c496-433c-be11-81840e42b26b"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:42.092036 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] validate_networks() for [('73901e32-c496-433c-be11-81840e42b26b', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:40:42.624711 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:40:42.625493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:40:42.626212 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:40:42.627065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:40:42.627830 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:40:42.639137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:42.639625 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:42.640622 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:42.641396 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:42.641836 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:42.642250 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:42.661059 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Getting quotas for project 7ebcc5baa03b430bb50f4110c5a79df9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:40:42.665313 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Getting quotas for user b4076a4c51a040a094aaae066772f9d2 and project 7ebcc5baa03b430bb50f4110c5a79df9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:40:42.682183 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:40:42.684557 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:40:42.779351 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0749b380-37bd-4ada-937a-0010b555959e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746636 Aug 24 17:40:42.780185 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 703/1425] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:40:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:40:42.788557 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=4 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:42.792652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c266e302-c1d1-42cb-a047-1f87ab254fdf tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:42.793455 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c266e302-c1d1-42cb-a047-1f87ab254fdf tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:42.849526 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c266e302-c1d1-42cb-a047-1f87ab254fdf tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:42.856495 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c266e302-c1d1-42cb-a047-1f87ab254fdf tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1219 microversion: 2.1 time: 0.069157 Aug 24 17:40:42.857072 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 723/1426] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:42 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:43.878341 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6f78aafd-8ad1-4d06-bfe4-e72fd8a5d063 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:43.878984 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6f78aafd-8ad1-4d06-bfe4-e72fd8a5d063 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:43.937011 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6f78aafd-8ad1-4d06-bfe4-e72fd8a5d063 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:43.944465 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6f78aafd-8ad1-4d06-bfe4-e72fd8a5d063 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1219 microversion: 2.1 time: 0.071185 Aug 24 17:40:43.945189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 704/1427] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:43 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:44.966915 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:44.967533 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:44.974689 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:44.976664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:44.976664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:44.976664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:44.977004 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:44.977281 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:45.056883 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:45.065676 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-66aebe99-b4a2-4621-a6dc-02015a907d02 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1271 microversion: 2.1 time: 0.103551 Aug 24 17:40:45.066267 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 724/1428] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:44 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:46.088016 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:46.088813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:46.098064 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.098735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.099142 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.099854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:46.100319 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:46.100751 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:46.245220 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:46.254235 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-56cf5c68-4c13-4a89-94e3-586a4ca7672b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1319 microversion: 2.1 time: 0.170236 Aug 24 17:40:46.254817 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 705/1429] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:46 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:47.053654 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-16f2d09d-2448-42a4-b8d3-95704ef09dc9 req-4929a722-3b07-49a3-91da-1f105b91d5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8223251f-a000-4403-9edc-c9da885fc0ad", "tag": "d0dfe93f-827f-49ee-a1db-75c4704e4105"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:47.068640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-16f2d09d-2448-42a4-b8d3-95704ef09dc9 req-4929a722-3b07-49a3-91da-1f105b91d5e7 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.069125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-16f2d09d-2448-42a4-b8d3-95704ef09dc9 req-4929a722-3b07-49a3-91da-1f105b91d5e7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.069556 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-16f2d09d-2448-42a4-b8d3-95704ef09dc9 req-4929a722-3b07-49a3-91da-1f105b91d5e7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.084302 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-16f2d09d-2448-42a4-b8d3-95704ef09dc9 req-4929a722-3b07-49a3-91da-1f105b91d5e7 service nova] Creating event network-changed:d0dfe93f-827f-49ee-a1db-75c4704e4105 for instance 8223251f-a000-4403-9edc-c9da885fc0ad on hv-cinder-85164 Aug 24 17:40:47.089978 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-16f2d09d-2448-42a4-b8d3-95704ef09dc9 req-4929a722-3b07-49a3-91da-1f105b91d5e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044099 Aug 24 17:40:47.093904 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 725/1430] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:47.275277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:47.276121 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:47.284315 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.285186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.285996 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.286758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:47.287294 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:47.287792 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:47.436166 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:47.444732 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a28add6b-3987-4a55-ad0a-0f45aee43fb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1319 microversion: 2.1 time: 0.173414 Aug 24 17:40:47.445346 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 706/1431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:47 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:48.466192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:48.466992 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:48.474138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:48.474624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:48.475077 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:48.475763 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:48.476217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:48.476640 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:48.613665 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:48.621518 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-50d79fc3-6002-4928-997e-4a1501a71b8f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1319 microversion: 2.1 time: 0.159515 Aug 24 17:40:48.622474 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 726/1432] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:48 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:49.644026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:49.644685 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:49.650888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:49.653459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:49.653459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:49.653459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:49.653459 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:49.653935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:49.799412 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:49.807536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3841deac-5d20-42a0-a85b-337e6f74e357 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1319 microversion: 2.1 time: 0.168522 Aug 24 17:40:49.810026 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 707/1433] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:49 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:50.830258 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:50.830869 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:50.837071 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.837520 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.837977 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:50.838664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:50.839140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:50.839564 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:50.972003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:50.979996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b2857e14-a565-4be2-82ce-dc512984d6ab tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1319 microversion: 2.1 time: 0.154390 Aug 24 17:40:50.980597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 727/1434] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:50 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:52.005851 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:52.006493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:52.013298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.013803 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.014243 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.014975 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:52.015944 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:52.016374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:52.163664 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:52.172241 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d5369321-e44d-42f0-af7d-397e8678f04e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1319 microversion: 2.1 time: 0.170198 Aug 24 17:40:52.172822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 708/1435] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:52 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:53.193232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:53.193872 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:53.196470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:53.202327 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.202999 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.203756 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.204568 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.205130 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.205647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.343324 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:53.351233 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-e76fc3e5-f840-4d4d-b42f-2e3c88b8d17c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1319 microversion: 2.1 time: 0.161768 Aug 24 17:40:53.351853 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 728/1436] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:53 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:53.683610 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-1e6f9786-1007-4650-8385-17d545e9055d req-bc14000d-9b98-4518-914e-9f518863b039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8223251f-a000-4403-9edc-c9da885fc0ad", "name": "network-vif-plugged", "status": "completed", "tag": "d0dfe93f-827f-49ee-a1db-75c4704e4105"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:40:53.688879 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:53.694658 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1e6f9786-1007-4650-8385-17d545e9055d req-bc14000d-9b98-4518-914e-9f518863b039 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:53.695169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1e6f9786-1007-4650-8385-17d545e9055d req-bc14000d-9b98-4518-914e-9f518863b039 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:53.695602 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-1e6f9786-1007-4650-8385-17d545e9055d req-bc14000d-9b98-4518-914e-9f518863b039 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:53.708266 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-1e6f9786-1007-4650-8385-17d545e9055d req-bc14000d-9b98-4518-914e-9f518863b039 service nova] Creating event network-vif-plugged:d0dfe93f-827f-49ee-a1db-75c4704e4105 for instance 8223251f-a000-4403-9edc-c9da885fc0ad on hv-cinder-85164 Aug 24 17:40:53.712480 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-1e6f9786-1007-4650-8385-17d545e9055d req-bc14000d-9b98-4518-914e-9f518863b039 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033056 Aug 24 17:40:53.713068 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 709/1437] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:40:54.372415 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:54.373088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:54.379897 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:54.380429 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:54.380872 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:54.381579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:54.382037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:54.382467 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:54.514642 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:54.522686 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-530f5772-b635-4620-ae86-5a8786851415 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1319 microversion: 2.1 time: 0.154189 Aug 24 17:40:54.523297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 729/1438] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:54 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:55.541768 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=8 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:40:55.549260 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:55.550256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:55.560595 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.561189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.561867 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.562680 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:55.563612 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:55.564156 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:55.723630 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:55.730608 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-fe972b81-7670-4d82-822c-0806e935a84e tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1319 microversion: 2.1 time: 0.190145 Aug 24 17:40:55.741787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 710/1439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:55 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:40:56.752520 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:40:56.753139 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:40:56.761117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:56.761117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:56.761117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:56.761117 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:40:56.761555 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:40:56.761898 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:40:56.897994 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:40:56.906592 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a02d18ff-b606-42af-99ad-920eca86c651 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1508 microversion: 2.1 time: 0.158535 Aug 24 17:40:56.907271 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 730/1440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:40:56 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:24.176087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:24.176982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=34 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:24.181208 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-d0bc64f3-119f-45e7-bd3a-3d1d2d8dbc1b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "326c03b6-8103-4b17-8d14-720bd0c9a31a", "device": "/dev/sdb"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:24.184130 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-d0bc64f3-119f-45e7-bd3a-3d1d2d8dbc1b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:41:24.191196 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bc64f3-119f-45e7-bd3a-3d1d2d8dbc1b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:24.194277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bc64f3-119f-45e7-bd3a-3d1d2d8dbc1b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:24.194277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bc64f3-119f-45e7-bd3a-3d1d2d8dbc1b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:24.194277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bc64f3-119f-45e7-bd3a-3d1d2d8dbc1b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:41:24.194277 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bc64f3-119f-45e7-bd3a-3d1d2d8dbc1b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:41:24.194796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-d0bc64f3-119f-45e7-bd3a-3d1d2d8dbc1b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:41:25.311776 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-d0bc64f3-119f-45e7-bd3a-3d1d2d8dbc1b tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "POST /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.136189 Aug 24 17:41:25.312560 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 711/1441] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:41:24 2022] POST /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:42:00.575884 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=18 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:00.576641 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=38 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:00.581507 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:00.582010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:00.588165 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:00.588657 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:00.589638 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:00.589833 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:00.590288 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:00.590718 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:00.726124 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lazy-loading 'services' on Instance uuid 8223251f-a000-4403-9edc-c9da885fc0ad {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:00.992018 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-aa2a3298-6916-4ffe-9ed5-aac69dfac01f tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad/os-volume_attachments/326c03b6-8103-4b17-8d14-720bd0c9a31a" status: 202 len: 0 microversion: 2.1 time: 0.417702 Aug 24 17:42:00.992681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 731/1442] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:42:00 2022] DELETE /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad/os-volume_attachments/326c03b6-8103-4b17-8d14-720bd0c9a31a => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:42:03.880003 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:03.888572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:03.888572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:03.888572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:03.893071 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:03.893903 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:03.894598 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:03.895515 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:03.895974 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:03.896400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:03.931544 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:42:04.068270 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-f3e36a7f-264c-4aaa-aff4-08c07f89cbcf req-56e01b40-43a7-44cb-8bee-bd1f21f76a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a7e303-08e1-4970-a0c8-e30d82054b93", "tag": "2b921a7d-2dbb-4c33-a5ee-bf04279355e3"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:04.077801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-f3e36a7f-264c-4aaa-aff4-08c07f89cbcf req-56e01b40-43a7-44cb-8bee-bd1f21f76a03 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:04.078525 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-f3e36a7f-264c-4aaa-aff4-08c07f89cbcf req-56e01b40-43a7-44cb-8bee-bd1f21f76a03 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:04.078974 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-f3e36a7f-264c-4aaa-aff4-08c07f89cbcf req-56e01b40-43a7-44cb-8bee-bd1f21f76a03 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:04.092624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-f3e36a7f-264c-4aaa-aff4-08c07f89cbcf req-56e01b40-43a7-44cb-8bee-bd1f21f76a03 service nova] Creating event network-changed:2b921a7d-2dbb-4c33-a5ee-bf04279355e3 for instance 68a7e303-08e1-4970-a0c8-e30d82054b93 on hv-cinder-85164 Aug 24 17:42:04.098878 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-f3e36a7f-264c-4aaa-aff4-08c07f89cbcf req-56e01b40-43a7-44cb-8bee-bd1f21f76a03 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217365 Aug 24 17:42:04.099509 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 732/1443] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:42:04.212812 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a301cc2a-e334-4b70-ba2f-6d8056ad2ae6 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "DELETE /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 204 len: 0 microversion: 2.1 time: 0.334116 Aug 24 17:42:04.214847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 712/1444] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:42:03 2022] DELETE /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:42:04.230030 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:04.231402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:04.241587 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:04.242737 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:04.243567 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:04.244531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:04.245185 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:04.246068 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:04.406357 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:04.415490 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-f122bcee-baac-4ded-84fc-4f55fc2bf5f0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.190933 Aug 24 17:42:04.416162 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 733/1445] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:04 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:05.438612 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:05.439947 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:05.446690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:05.447211 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:05.447646 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:05.448370 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:05.448813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:05.449229 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:05.587675 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:05.595585 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c3f83bf9-c64d-4f23-b051-c0d4e8c9d531 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.161715 Aug 24 17:42:05.596461 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 713/1446] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:05 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:42:06.617056 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:06.617747 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:06.624170 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:06.631224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:06.631224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:06.631224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:06.631224 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:06.631638 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:06.763688 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:06.771639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-b3bd40c3-0acc-4d23-be1c-ac956d07d4dc tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.158426 Aug 24 17:42:06.772211 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 734/1447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:06 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:07.792822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:07.793418 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:07.799973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.800395 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.800829 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.801514 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:07.801962 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:07.802380 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:07.934828 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:07.943587 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-af5adb59-bd0d-45d5-83b6-871070ab31f3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.154306 Aug 24 17:42:07.947308 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 714/1448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:07 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:08.965320 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:08.966012 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:08.973410 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:08.973905 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:08.974410 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:08.975212 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:08.975737 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:08.976233 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:09.112882 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:09.120624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c4a2de76-3cb4-4d9d-abfa-21610cb925d3 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.159402 Aug 24 17:42:09.121192 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 735/1449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:08 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:10.141616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:10.142188 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:10.149345 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:10.154534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:10.154534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:10.154534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:10.154534 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:10.154955 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:10.281471 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:10.289872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-698ef36d-9356-489f-a965-b3d4d7da2fa9 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.152110 Aug 24 17:42:10.290461 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 715/1450] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:10 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:11.311594 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:11.312135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:11.319217 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:11.319702 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:11.320135 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:11.320818 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:11.321268 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:11.321691 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:11.459317 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:11.467493 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a8d793f5-fdea-4d7f-b60b-27130be5501e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.159940 Aug 24 17:42:11.468062 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 736/1451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:11 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:12.488527 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:12.489065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:12.495474 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:12.495951 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:12.496665 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.497352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:12.497799 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:12.498218 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:12.629967 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:12.637862 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c4bfe2f9-83b9-46c6-a675-3b1acdf50f58 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.153290 Aug 24 17:42:12.638447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 716/1452] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:12 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:13.659824 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:13.661013 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:13.667660 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:13.670799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:13.670799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:13.670799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:13.670799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:13.672245 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:13.831711 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:13.836131 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-a627d082-6b0d-41f5-a214-0f6b1e8dc251 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.180802 Aug 24 17:42:13.836942 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 737/1453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:13 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:14.858935 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:14.860082 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:14.870408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:14.871049 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:14.871493 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:14.872203 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:14.872686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:14.873098 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:15.022807 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:15.031239 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-502e0e34-1862-4668-975f-5961fc060ce8 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.177418 Aug 24 17:42:15.031821 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 717/1454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:14 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:16.061393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:16.062127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:16.069597 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.070195 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.070724 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.071462 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:16.071928 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:16.072358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:16.279723 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:16.289264 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-5bfd4e33-5ea9-458c-9005-2046596d840b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.231825 Aug 24 17:42:16.289863 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 738/1455] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:16 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:17.316578 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:17.317184 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:17.323772 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:17.324258 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:17.324690 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:17.325384 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:17.325831 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:17.326249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:17.458282 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:17.466121 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-0a235de3-bf66-44e3-bc8d-670fb03b3e21 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.154000 Aug 24 17:42:17.466697 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 718/1456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:17 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:18.487094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:18.487703 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:18.494241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:18.494722 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:18.495181 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:18.495879 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:18.496330 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:18.496801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:18.636451 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:18.645027 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-651d8456-efc8-4d28-837b-f547dd7267f5 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.161287 Aug 24 17:42:18.645606 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 739/1457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:18 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:19.666445 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:19.667149 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:19.673410 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:19.674079 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:19.674326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:19.675065 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:19.675632 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:19.675933 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:19.811847 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:19.820103 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-311bb28d-e88a-4788-b4d0-14eb53213e40 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1568 microversion: 2.1 time: 0.157569 Aug 24 17:42:19.820679 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 719/1458] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:19 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:20.841892 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:20.842511 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:20.850790 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.851318 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.851927 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:20.852733 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:20.853184 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:20.853607 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:21.257312 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-5396d9df-1860-460c-8df6-34682983e23a req-ce4c38fd-dec9-460b-a08b-0d2e96dda08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a7e303-08e1-4970-a0c8-e30d82054b93", "name": "network-vif-deleted", "tag": "2b921a7d-2dbb-4c33-a5ee-bf04279355e3"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:21.272374 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5396d9df-1860-460c-8df6-34682983e23a req-ce4c38fd-dec9-460b-a08b-0d2e96dda08f service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:21.272973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5396d9df-1860-460c-8df6-34682983e23a req-ce4c38fd-dec9-460b-a08b-0d2e96dda08f service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:21.273497 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-5396d9df-1860-460c-8df6-34682983e23a req-ce4c38fd-dec9-460b-a08b-0d2e96dda08f service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:21.287766 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-5396d9df-1860-460c-8df6-34682983e23a req-ce4c38fd-dec9-460b-a08b-0d2e96dda08f service nova] Creating event network-vif-deleted:2b921a7d-2dbb-4c33-a5ee-bf04279355e3 for instance 68a7e303-08e1-4970-a0c8-e30d82054b93 on hv-cinder-85164 Aug 24 17:42:21.296099 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-5396d9df-1860-460c-8df6-34682983e23a req-ce4c38fd-dec9-460b-a08b-0d2e96dda08f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044552 Aug 24 17:42:21.297298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 720/1459] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:21.301664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:21.319319 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-30dece14-8b71-464f-8271-1cfa879a25e0 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1449 microversion: 2.1 time: 0.481150 Aug 24 17:42:21.321137 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 740/1460] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:20 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1449 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:22.342015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:22.342744 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:22.349173 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.349655 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.350481 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.350774 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.351262 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.351682 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.389287 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:22.389783 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:22.399801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.400687 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.401440 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.402241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.404551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.405065 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.420620 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:22.431154 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-c0a11749-d37c-464c-bda4-e3abb57f5287 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1220 microversion: 2.1 time: 0.093916 Aug 24 17:42:22.435693 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 721/1461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:22 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:22.444936 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Going to try to terminate instance {{(pid=121011) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:42:22.763635 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-4db36e1d-c4a8-46e7-9692-6a8a8abd3f62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 204 len: 0 microversion: 2.1 time: 0.378200 Aug 24 17:42:22.764138 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 741/1462] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:42:22 2022] DELETE /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:42:22.772463 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:22.773069 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:22.779217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.779703 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.780165 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.780856 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:22.781306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:22.781721 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:22.921728 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:22.930302 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-99b092ff-3e4f-4597-896a-2e44828eb19c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1514 microversion: 2.1 time: 0.161657 Aug 24 17:42:22.930885 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 722/1463] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:22 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:23.452694 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:23.453392 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:23.459786 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.460265 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.460699 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:23.461375 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.461822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.462242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:23.493245 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.493716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.494145 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:23.494584 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lazy-loading 'fault' on Instance uuid 68a7e303-08e1-4970-a0c8-e30d82054b93 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:23.535531 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:23.543354 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0f30450c-a9d1-4a9d-aa02-06dd4b137046 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1225 microversion: 2.1 time: 0.094792 Aug 24 17:42:23.543922 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 742/1464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:23 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:23.952450 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:23.953047 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:23.960217 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.960701 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.961133 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:23.961825 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:23.962272 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:23.962689 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.103539 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:24.111411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4239367c-2aac-4dd8-b468-cd23c92b1a62 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1514 microversion: 2.1 time: 0.162721 Aug 24 17:42:24.111984 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 723/1465] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:23 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:24.564799 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:24.565435 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:24.572754 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:24.573218 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:24.573684 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.574408 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:24.574864 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:24.575316 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.606619 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:24.607134 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:24.607562 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:24.608008 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lazy-loading 'fault' on Instance uuid 68a7e303-08e1-4970-a0c8-e30d82054b93 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:24.652822 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:24.661149 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0dacc88d-7652-48cd-b6ab-caa0af2e2690 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1225 microversion: 2.1 time: 0.100183 Aug 24 17:42:24.661732 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 743/1466] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:24 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:25.133179 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:25.133752 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:25.140787 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.141280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.141715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.142421 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.142872 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.143325 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.275650 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:25.284190 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1ef2b081-c419-47c4-a6f9-e6e8a0b25770 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1514 microversion: 2.1 time: 0.154965 Aug 24 17:42:25.284813 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 724/1467] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:25 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:25.824037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:25.824037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:25.824037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.824037 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.825769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.825769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.825769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.825769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.826140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:25.826140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:25.826140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:25.826140 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lazy-loading 'fault' on Instance uuid 68a7e303-08e1-4970-a0c8-e30d82054b93 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:25.826486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:25.826486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:25.826486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-70e6ce48-e55b-406b-9ede-d088c5c54d9c tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1225 microversion: 2.1 time: 0.106169 Aug 24 17:42:25.826486 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 744/1468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:25 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:26.305643 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:26.306293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:26.312718 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.313201 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.313641 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.314339 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.314791 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.315245 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.475073 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:26.483093 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-784d9a51-d3ba-480b-882e-6a42fa9afb12 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1514 microversion: 2.1 time: 0.181325 Aug 24 17:42:26.483679 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 725/1469] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:26 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:26.809010 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:26.809651 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:26.816745 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.817229 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.817661 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.818350 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.818812 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.819251 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.852751 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:26.853460 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:26.855182 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:26.855182 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lazy-loading 'fault' on Instance uuid 68a7e303-08e1-4970-a0c8-e30d82054b93 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:26.898156 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:26.906054 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-524ac379-38e6-4e6f-8b32-d4d3917b6c0e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1225 microversion: 2.1 time: 0.101321 Aug 24 17:42:26.906778 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 745/1470] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:26 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:27.506267 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:27.507758 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:27.514676 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:27.515256 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:27.515447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.515999 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:27.516412 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:27.516849 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.660883 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:27.671391 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-854cc892-0cb2-4a6c-b843-eaa635406ed3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1514 microversion: 2.1 time: 0.169717 Aug 24 17:42:27.672171 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 726/1471] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:27 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:27.927687 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:27.928518 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:27.935484 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:27.935999 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:27.936427 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.937127 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:27.937578 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:27.938003 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.971796 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:27.972834 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:27.973282 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:27.973741 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lazy-loading 'fault' on Instance uuid 68a7e303-08e1-4970-a0c8-e30d82054b93 {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:28.019202 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df56db015514caa8aa92ffcfe227914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a66fdbac83c47b59c88adbe6b82ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:28.027323 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-551a37c0-3760-423b-9df5-86aa4dd6c93e tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 200 len: 1225 microversion: 2.1 time: 0.104286 Aug 24 17:42:28.027914 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 746/1472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:27 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:28.694193 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:28.695486 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:28.702440 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.702954 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.703393 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.704084 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.704531 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.704948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.728195 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:28.779219 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:28.791076 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-6571a790-eecf-41ee-8304-2a3f9e251c3c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1472 microversion: 2.1 time: 0.100907 Aug 24 17:42:28.791788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 727/1473] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:28 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1472 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:28.820931 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-81ab2f3e-794f-4b93-be70-24195fdda846 req-218e6e7f-592f-4437-86f0-9e598cc19f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8223251f-a000-4403-9edc-c9da885fc0ad", "name": "network-vif-deleted", "tag": "d0dfe93f-827f-49ee-a1db-75c4704e4105"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:28.830232 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-81ab2f3e-794f-4b93-be70-24195fdda846 req-218e6e7f-592f-4437-86f0-9e598cc19f2a service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:28.830707 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-81ab2f3e-794f-4b93-be70-24195fdda846 req-218e6e7f-592f-4437-86f0-9e598cc19f2a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:28.831157 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-81ab2f3e-794f-4b93-be70-24195fdda846 req-218e6e7f-592f-4437-86f0-9e598cc19f2a service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:28.842535 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-81ab2f3e-794f-4b93-be70-24195fdda846 req-218e6e7f-592f-4437-86f0-9e598cc19f2a service nova] Creating event network-vif-deleted:d0dfe93f-827f-49ee-a1db-75c4704e4105 for instance 8223251f-a000-4403-9edc-c9da885fc0ad on hv-cinder-85164 Aug 24 17:42:28.847517 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-81ab2f3e-794f-4b93-be70-24195fdda846 req-218e6e7f-592f-4437-86f0-9e598cc19f2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030205 Aug 24 17:42:28.848249 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 747/1474] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:29.049165 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:29.049780 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] [instance: 68a7e303-08e1-4970-a0c8-e30d82054b93] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:29.056948 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.057436 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.057876 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.058683 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.059158 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.059582 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.073565 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] HTTP exception thrown: Instance 68a7e303-08e1-4970-a0c8-e30d82054b93 could not be found. Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Request method failure captured: Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 HTTP/1.1 Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBmFV6Sjjitk2UZ_4U5hjq-Qr-j4QfWIu7GAIPZfYSYOtvuh_DBVYsfZHUNbsQtRYZW_E_otuTAuV2Afsm88C9F0sAXuAOF4U1xz4dNV-AjsMnjc_ZGMvpViyFjVkrX76xyB3c1GEOqB-Z2Rw2yBJmMo566uOrBE4SJuomAgRjHCAfSg Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 2a66fdbac83c47b59c88adbe6b82ff8a Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-TestShelveInstance-1472628262 Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:42:29.075355 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2a66fdbac83c47b59c88adbe6b82ff8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2a66fdbac83c47b59c88adbe6b82ff8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2a66fdbac83c47b59c88adbe6b82ff8a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2a66fdbac83c47b59c88adbe6b82ff8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-TestShelveInstance-1472628262 Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 2a66fdbac83c47b59c88adbe6b82ff8a Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-TestShelveInstance-1472628262 Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-TestShelveInstance-1472628262-project Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: 4df56db015514caa8aa92ffcfe227914 Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-TestShelveInstance-1472628262-project Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 68a7e303-08e1-4970-a0c8-e30d82054b93 could not be found. Aug 24 17:42:29.076982 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '68a7e303-08e1-4970-a0c8-e30d82054b93'} Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a7e303-08e1-4970-a0c8-e30d82054b93 could not be found. Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:29.077871 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a7e303-08e1-4970-a0c8-e30d82054b93 could not be found. Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a7e303-08e1-4970-a0c8-e30d82054b93 could not be found. Aug 24 17:42:29.082033 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:42:29.083992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Returning 404 to user: Instance 68a7e303-08e1-4970-a0c8-e30d82054b93 could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:29.083992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-eadb0f45-7a79-4285-9bc4-c5fc0545cd9b tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93" status: 404 len: 111 microversion: 2.1 time: 0.031566 Aug 24 17:42:29.083992 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 728/1475] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:29 2022] GET /compute/v2.1/servers/68a7e303-08e1-4970-a0c8-e30d82054b93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:42:29.346769 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-cca95c93-8699-43c1-8f53-d8a9d6e8f435 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] Calling method '.version_select at 0x7f3f309a49d0>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:29.473851 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-cca95c93-8699-43c1-8f53-d8a9d6e8f435 tempest-TestShelveInstance-1472628262 tempest-TestShelveInstance-1472628262-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1730836924" status: 202 len: 0 microversion: 2.1 time: 0.131902 Aug 24 17:42:29.474351 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 748/1476] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Aug 24 17:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1730836924 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:42:29.812959 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:29.813653 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:29.820784 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.821274 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.821707 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.822400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.822854 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.823306 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.856810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:29.857309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:29.857805 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:29.858264 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.objects.instance [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lazy-loading 'fault' on Instance uuid 8223251f-a000-4403-9edc-c9da885fc0ad {{(pid=121010) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:42:29.914186 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:29.921323 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-4d11a30a-391b-4f9a-a3b1-08f262f38eb9 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 200 len: 1309 microversion: 2.1 time: 0.112556 Aug 24 17:42:29.922075 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 729/1477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:29 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:30.942975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:30.943647 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 8223251f-a000-4403-9edc-c9da885fc0ad] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:30.945565 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:30.952748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.953244 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.955512 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.955512 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:30.955512 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:30.955512 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:30.968906 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.wsgi [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] HTTP exception thrown: Instance 8223251f-a000-4403-9edc-c9da885fc0ad could not be found. Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Request method failure captured: Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: request: GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad HTTP/1.1 Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept: application/json Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Accept-Encoding: identity Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Connection: close Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Length: 0 Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Content-Type: application/json Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Host: 10.222.0.18 Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Openstack-System-Scope: None Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: User-Agent: python-urllib3/1.26.11 Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Auth-Token: gAAAAABjBmKXlauSsQJGu-6aM4TRnY5Vat97dUwSxiwT97CVa7EfKryrvApe69Ewl5YagHaGwfr4Q98RhCA9lkRM9Vr-4H6neWhZWTJTf2vmF2X9iz-Sjwq9FuVNriLE52jOysFw315k0dswEhEMqzswTPDBlkT3dj_GGXxSMlkNbRLgrHMk2_Y Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Id: None Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Domain-Name: None Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Identity-Status: Confirmed Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Is-Admin-Project: True Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Id: default Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Domain-Name: Default Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Id: 7ebcc5baa03b430bb50f4110c5a79df9 Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1331737394 Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Role: member,reader Aug 24 17:42:30.970470 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Roles: member,reader Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ebcc5baa03b430bb50f4110c5a79df9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ebcc5baa03b430bb50f4110c5a79df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7ebcc5baa03b430bb50f4110c5a79df9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7ebcc5baa03b430bb50f4110c5a79df9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant: tempest-VolumesSnapshotTestJSON-1331737394 Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Id: 7ebcc5baa03b430bb50f4110c5a79df9 Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1331737394 Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User: tempest-VolumesSnapshotTestJSON-1331737394-project Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Id: default Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Domain-Name: Default Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Id: b4076a4c51a040a094aaae066772f9d2 Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: X-User-Name: tempest-VolumesSnapshotTestJSON-1331737394-project Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: method: > Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: exception: Instance 8223251f-a000-4403-9edc-c9da885fc0ad could not be found. Aug 24 17:42:30.972810 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: action_args: {'id': '8223251f-a000-4403-9edc-c9da885fc0ad'} Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8223251f-a000-4403-9edc-c9da885fc0ad could not be found. Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:30.974179 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8223251f-a000-4403-9edc-c9da885fc0ad could not be found. Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8223251f-a000-4403-9edc-c9da885fc0ad could not be found. Aug 24 17:42:30.975806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: ERROR nova.api.openstack.wsgi Aug 24 17:42:30.977996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Returning 404 to user: Instance 8223251f-a000-4403-9edc-c9da885fc0ad could not be found. {{(pid=121011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:30.977996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-9b7c5fe1-6004-46e9-ab05-43915eb1b0ed tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad" status: 404 len: 111 microversion: 2.1 time: 0.033537 Aug 24 17:42:30.977996 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 749/1478] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:30 2022] GET /compute/v2.1/servers/8223251f-a000-4403-9edc-c9da885fc0ad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:42:36.460735 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:42:36.461357 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Wed Aug 24 17:42:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:42:40.979087 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:42:40.979693 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Wed Aug 24 17:42:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:42:43.662298 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-716225705", "imageRef": "7a87f663-1354-4773-98ec-67491330b79c", "flavorRef": "452", "networks": [{"uuid": "73901e32-c496-433c-be11-81840e42b26b"}]}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:43.670875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:43.671554 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=12 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:43.727015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.network.neutron [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] validate_networks() for [('73901e32-c496-433c-be11-81840e42b26b', None, None, None, None, None)] {{(pid=121010) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:42:44.075973 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Flavor limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:42:44.076408 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Image limits 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:42:44.076888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Flavor pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:42:44.077300 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Image pref 0:0:0 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:42:44.077717 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.virt.hardware [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121010) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:42:44.086950 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:44.087436 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:44.087874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:44.088603 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:44.089056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:44.089535 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:44.105874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Getting quotas for project 7ebcc5baa03b430bb50f4110c5a79df9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:42:44.109843 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.quota [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Getting quotas for user b4076a4c51a040a094aaae066772f9d2 and project 7ebcc5baa03b430bb50f4110c5a79df9. Resources: {'cores', 'instances', 'ram'} {{(pid=121010) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:42:44.121265 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Going to run 1 instances... {{(pid=121010) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:42:44.123556 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a87f663-1354-4773-98ec-67491330b79c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121010) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:42:44.259759 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-3556cc53-42d8-4b53-b9e8-74b5c9c6a948 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601448 Aug 24 17:42:44.260400 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 730/1479] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Aug 24 17:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:42:44.271166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bc5fd8c4-84b9-4983-891b-f0dd289dca9d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:44.271792 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bc5fd8c4-84b9-4983-891b-f0dd289dca9d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:44.274633 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=20 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:44.329033 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bc5fd8c4-84b9-4983-891b-f0dd289dca9d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:44.337295 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bc5fd8c4-84b9-4983-891b-f0dd289dca9d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1218 microversion: 2.1 time: 0.069903 Aug 24 17:42:44.338088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 750/1480] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:44 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:45.359827 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:45.360455 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:45.367428 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:45.367914 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:45.368350 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:45.369037 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:45.369485 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:45.369904 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:45.436013 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:45.444536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dbcae48e-45fe-4130-99b1-5da62b7c60b7 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1222 microversion: 2.1 time: 0.090373 Aug 24 17:42:45.445091 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 731/1481] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:45 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:46.465548 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:46.466174 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:46.474078 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:46.478339 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:46.478339 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:46.478339 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:46.478339 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:46.478929 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:46.540766 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:46.558845 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-0dca699c-92e6-4e8b-8dae-f1284b862ae8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1278 microversion: 2.1 time: 0.097133 Aug 24 17:42:46.559664 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 751/1482] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:46 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:47.579919 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:47.580537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:47.587597 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:47.588087 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:47.588529 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:47.589231 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:47.589686 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:47.590113 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:47.719731 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:47.727572 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8a08b57e-fb21-4741-a6bc-ef91638bfb77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1318 microversion: 2.1 time: 0.151512 Aug 24 17:42:47.728137 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 732/1483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:47 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:48.023468 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-a2e5d265-5d40-4ec8-a905-a6e0b755ca26 req-33339f95-54f2-4a84-8bb0-453f57d20787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137b2582-da44-46ab-bada-51ce26ff3f6e", "tag": "26422d85-452d-4257-9424-fea32effd794"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:48.033823 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a2e5d265-5d40-4ec8-a905-a6e0b755ca26 req-33339f95-54f2-4a84-8bb0-453f57d20787 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:48.034330 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a2e5d265-5d40-4ec8-a905-a6e0b755ca26 req-33339f95-54f2-4a84-8bb0-453f57d20787 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:48.034773 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a2e5d265-5d40-4ec8-a905-a6e0b755ca26 req-33339f95-54f2-4a84-8bb0-453f57d20787 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:48.046637 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-a2e5d265-5d40-4ec8-a905-a6e0b755ca26 req-33339f95-54f2-4a84-8bb0-453f57d20787 service nova] Creating event network-changed:26422d85-452d-4257-9424-fea32effd794 for instance 137b2582-da44-46ab-bada-51ce26ff3f6e on hv-cinder-85164 Aug 24 17:42:48.051652 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-a2e5d265-5d40-4ec8-a905-a6e0b755ca26 req-33339f95-54f2-4a84-8bb0-453f57d20787 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035183 Aug 24 17:42:48.053045 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 752/1484] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:48.749280 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:48.749887 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:48.756482 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:48.756965 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:48.757409 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:48.758113 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:48.758570 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:48.759022 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:48.905206 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:48.913584 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b954d747-e56e-456a-98ed-d6e1d3311b60 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1318 microversion: 2.1 time: 0.168278 Aug 24 17:42:48.914168 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 733/1485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:48 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:49.934809 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:49.935536 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:49.942035 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:49.942562 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:49.943040 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:49.943737 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:49.944191 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:49.944616 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:50.078265 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:50.086449 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-67321400-a466-4180-afbf-a29214738380 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1318 microversion: 2.1 time: 0.156430 Aug 24 17:42:50.087046 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 753/1486] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:49 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:51.107910 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:51.108554 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:51.115673 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:51.124624 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:51.124624 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:51.124624 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:51.124624 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:51.125056 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:51.259491 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:51.268663 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-a3b4ce00-62d2-4b86-8dc5-08fe45f6b58c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1318 microversion: 2.1 time: 0.164672 Aug 24 17:42:51.269228 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 734/1487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:51 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:52.289553 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:52.290166 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:52.296315 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:52.296840 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:52.297275 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:52.297959 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:52.298436 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:52.298878 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:52.438241 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:52.448861 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-3d050b2b-9881-44fc-84a9-c4c9f42aeb29 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1318 microversion: 2.1 time: 0.163295 Aug 24 17:42:52.449437 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 754/1488] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:52 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:53.469109 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:53.469715 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:53.476818 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:53.477293 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:53.477796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:53.478472 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:53.478925 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:53.479352 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:53.613536 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:53.621926 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-8f9cf6ef-8c09-49fc-a76c-f472f5515a5c tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1318 microversion: 2.1 time: 0.156676 Aug 24 17:42:53.622499 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 735/1489] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:53 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:53.687049 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [req-a9fd70c1-9d7b-498e-b964-56ffb0cbaf0b req-833aef8c-997b-466b-b2ac-1abc7af06e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137b2582-da44-46ab-bada-51ce26ff3f6e", "name": "network-vif-plugged", "status": "completed", "tag": "26422d85-452d-4257-9424-fea32effd794"}]} {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:53.696609 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a9fd70c1-9d7b-498e-b964-56ffb0cbaf0b req-833aef8c-997b-466b-b2ac-1abc7af06e7e service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:53.697088 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a9fd70c1-9d7b-498e-b964-56ffb0cbaf0b req-833aef8c-997b-466b-b2ac-1abc7af06e7e service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:53.697627 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [req-a9fd70c1-9d7b-498e-b964-56ffb0cbaf0b req-833aef8c-997b-466b-b2ac-1abc7af06e7e service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:53.709565 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.compute.server_external_events [req-a9fd70c1-9d7b-498e-b964-56ffb0cbaf0b req-833aef8c-997b-466b-b2ac-1abc7af06e7e service nova] Creating event network-vif-plugged:26422d85-452d-4257-9424-fea32effd794 for instance 137b2582-da44-46ab-bada-51ce26ff3f6e on hv-cinder-85164 Aug 24 17:42:53.714523 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [req-a9fd70c1-9d7b-498e-b964-56ffb0cbaf0b req-833aef8c-997b-466b-b2ac-1abc7af06e7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155814 Aug 24 17:42:53.715168 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 755/1490] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:54.643309 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:54.644425 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:54.645942 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=2 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:54.646645 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell0:SELECT=6 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:54.651984 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:54.652381 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:54.652815 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:54.653506 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:54.653951 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:54.654369 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:54.790540 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:54.798321 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-dd2d5885-7788-41f4-842e-02bab4dd5a27 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1318 microversion: 2.1 time: 0.159036 Aug 24 17:42:54.798888 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 736/1491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:54 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:55.831734 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell0:SELECT=2 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:42:55.837155 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:55.837849 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:55.844064 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:55.844542 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:55.844975 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:55.845656 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:55.846103 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:55.846522 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:55.982297 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:42:55.991171 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-fc4c1085-7155-45a3-b48b-24942b0e35e3 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1507 microversion: 2.1 time: 0.160392 Aug 24 17:42:55.991748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 756/1492] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:42:55 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:42:56.012189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-48e5faba-4248-4b66-a5d5-fbee5675bf77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb95f131-0a0e-4e83-bf13-29f21b100f65", "device": "/dev/sdb"}} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:56.014796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-48e5faba-4248-4b66-a5d5-fbee5675bf77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:42:56.021377 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48e5faba-4248-4b66-a5d5-fbee5675bf77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:56.021866 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48e5faba-4248-4b66-a5d5-fbee5675bf77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:56.022307 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48e5faba-4248-4b66-a5d5-fbee5675bf77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:56.023023 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48e5faba-4248-4b66-a5d5-fbee5675bf77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:42:56.023487 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48e5faba-4248-4b66-a5d5-fbee5675bf77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:42:56.025249 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-48e5faba-4248-4b66-a5d5-fbee5675bf77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:42:56.710189 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-48e5faba-4248-4b66-a5d5-fbee5675bf77 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "POST /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701639 Aug 24 17:42:56.710722 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 737/1493] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Aug 24 17:42:56 2022] POST /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:43:20.004662 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:20.005213 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:20.007681 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_api:SELECT=17 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:20.008402 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG dbcounter [-] [121011] Writing DB stats nova_cell1:SELECT=28 {{(pid=121011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:20.013116 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:20.013610 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:20.014051 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:20.014748 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:20.015240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:20.015758 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:20.096240 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lazy-loading 'services' on Instance uuid 137b2582-da44-46ab-bada-51ce26ff3f6e {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:43:20.316085 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-c5cefa79-101c-4615-94b4-b4f4d4ed9a01 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "DELETE /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e/os-volume_attachments/fb95f131-0a0e-4e83-bf13-29f21b100f65" status: 202 len: 0 microversion: 2.1 time: 0.315080 Aug 24 17:43:20.316746 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 757/1494] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Aug 24 17:43:19 2022] DELETE /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e/os-volume_attachments/fb95f131-0a0e-4e83-bf13-29f21b100f65 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:43:22.493826 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:22.494633 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG dbcounter [-] [121010] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121010) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:22.498964 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:22.499616 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:22.506503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:22.506503 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:22.506757 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:22.507451 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:22.507901 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:22.508439 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:22.534169 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Going to try to terminate instance {{(pid=121010) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:43:22.802809 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-1cc7988c-c0f7-4316-a281-22fde42dce63 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "DELETE /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 204 len: 0 microversion: 2.1 time: 0.310121 Aug 24 17:43:22.803364 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 738/1495] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Aug 24 17:43:22 2022] DELETE /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:43:22.813104 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:22.813836 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:22.820504 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:22.820991 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:22.821431 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:22.822125 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:22.822579 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:22.823094 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:22.975077 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:22.985242 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-1684d224-048b-4d14-ba11-110b423969f8 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1513 microversion: 2.1 time: 0.176773 Aug 24 17:43:22.985832 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 758/1496] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:22 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:24.007209 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:24.007908 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:24.014378 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:24.014869 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:24.015323 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:24.016014 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:24.016463 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:24.016874 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:24.156588 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.policy [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121010) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:24.165235 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-b57d84f6-99bf-4d44-a424-d49fc9ce9642 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1513 microversion: 2.1 time: 0.162277 Aug 24 17:43:24.165911 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 739/1497] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:24 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:25.185777 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:25.186414 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:25.193041 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:25.193673 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:25.194141 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:25.194852 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:25.195358 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:25.195781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:25.330624 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:25.338528 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-bdbc3ebb-50f4-4a9d-814c-1bcf3d87b971 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1513 microversion: 2.1 time: 0.156745 Aug 24 17:43:25.339551 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 759/1498] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:25 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:25.866015 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [req-8da60824-5c97-4b22-8a79-acdcc7711db6 req-9b1422c9-f470-4b97-afb3-0f766be095f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137b2582-da44-46ab-bada-51ce26ff3f6e", "name": "network-vif-deleted", "tag": "26422d85-452d-4257-9424-fea32effd794"}]} {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:43:25.877326 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8da60824-5c97-4b22-8a79-acdcc7711db6 req-9b1422c9-f470-4b97-afb3-0f766be095f7 service nova] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:25.877810 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8da60824-5c97-4b22-8a79-acdcc7711db6 req-9b1422c9-f470-4b97-afb3-0f766be095f7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:25.878246 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [req-8da60824-5c97-4b22-8a79-acdcc7711db6 req-9b1422c9-f470-4b97-afb3-0f766be095f7 service nova] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:25.889788 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.compute.server_external_events [req-8da60824-5c97-4b22-8a79-acdcc7711db6 req-9b1422c9-f470-4b97-afb3-0f766be095f7 service nova] Creating event network-vif-deleted:26422d85-452d-4257-9424-fea32effd794 for instance 137b2582-da44-46ab-bada-51ce26ff3f6e on hv-cinder-85164 Aug 24 17:43:25.894796 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [req-8da60824-5c97-4b22-8a79-acdcc7711db6 req-9b1422c9-f470-4b97-afb3-0f766be095f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032519 Aug 24 17:43:25.901978 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 740/1499] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Aug 24 17:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:43:26.359959 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.api.openstack.wsgi [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:26.360583 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.compute.api [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121011) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:26.368223 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:26.371909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:26.371909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:26.371909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:26.371909 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:26.372340 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:26.406225 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:26.406716 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:26.407181 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG oslo_concurrency.lockutils [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:26.407639 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.objects.instance [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lazy-loading 'fault' on Instance uuid 137b2582-da44-46ab-bada-51ce26ff3f6e {{(pid=121011) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:43:26.449245 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: DEBUG nova.policy [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4076a4c51a040a094aaae066772f9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ebcc5baa03b430bb50f4110c5a79df9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121011) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:43:26.457227 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO nova.api.openstack.requestlog [None req-d33b4c4d-8deb-475a-905f-a2ada9160eb0 tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 200 len: 1308 microversion: 2.1 time: 0.101176 Aug 24 17:43:26.457801 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: [pid: 121011|app: 0|req: 760/1500] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:26 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:27.481886 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Calling method '>' {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:27.482729 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.compute.api [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] [instance: 137b2582-da44-46ab-bada-51ce26ff3f6e] Fetching instance by UUID {{(pid=121010) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:43:27.491707 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:27.492244 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:27.492755 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:27.493495 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Acquiring lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:43:27.494048 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:43:27.494537 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG oslo_concurrency.lockutils [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Lock "5dfaa778-4c3d-4303-9287-6e7cd5ae3954" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121010) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:43:27.509095 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.wsgi [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] HTTP exception thrown: Instance 137b2582-da44-46ab-bada-51ce26ff3f6e could not be found. Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Request method failure captured: Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: request: GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e HTTP/1.1 Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept: application/json Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Accept-Encoding: identity Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Connection: close Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Length: 0 Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Content-Type: application/json Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Host: 10.222.0.18 Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Openstack-System-Scope: None Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: User-Agent: python-urllib3/1.26.11 Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Auth-Token: gAAAAABjBmKXlauSsQJGu-6aM4TRnY5Vat97dUwSxiwT97CVa7EfKryrvApe69Ewl5YagHaGwfr4Q98RhCA9lkRM9Vr-4H6neWhZWTJTf2vmF2X9iz-Sjwq9FuVNriLE52jOysFw315k0dswEhEMqzswTPDBlkT3dj_GGXxSMlkNbRLgrHMk2_Y Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Id: None Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Domain-Name: None Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Identity-Status: Confirmed Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Is-Admin-Project: True Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Id: default Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Domain-Name: Default Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Id: 7ebcc5baa03b430bb50f4110c5a79df9 Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1331737394 Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Role: member,reader Aug 24 17:43:27.516797 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Roles: member,reader Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ebcc5baa03b430bb50f4110c5a79df9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7ebcc5baa03b430bb50f4110c5a79df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7ebcc5baa03b430bb50f4110c5a79df9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7ebcc5baa03b430bb50f4110c5a79df9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant: tempest-VolumesSnapshotTestJSON-1331737394 Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Id: 7ebcc5baa03b430bb50f4110c5a79df9 Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1331737394 Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User: tempest-VolumesSnapshotTestJSON-1331737394-project Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Id: default Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Domain-Name: Default Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Id: b4076a4c51a040a094aaae066772f9d2 Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: X-User-Name: tempest-VolumesSnapshotTestJSON-1331737394-project Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: method: > Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: exception: Instance 137b2582-da44-46ab-bada-51ce26ff3f6e could not be found. Aug 24 17:43:27.518456 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: action_args: {'id': '137b2582-da44-46ab-bada-51ce26ff3f6e'} Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: {{(pid=121010) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 137b2582-da44-46ab-bada-51ce26ff3f6e could not be found. Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:43:27.519365 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 137b2582-da44-46ab-bada-51ce26ff3f6e could not be found. Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 137b2582-da44-46ab-bada-51ce26ff3f6e could not be found. Aug 24 17:43:27.520875 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: ERROR nova.api.openstack.wsgi Aug 24 17:43:27.522227 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: DEBUG nova.api.openstack.wsgi [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] Returning 404 to user: Instance 137b2582-da44-46ab-bada-51ce26ff3f6e could not be found. {{(pid=121010) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:43:27.522227 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO nova.api.openstack.requestlog [None req-50337a13-9740-45cf-9d61-49f99d4ace0d tempest-VolumesSnapshotTestJSON-1331737394 tempest-VolumesSnapshotTestJSON-1331737394-project] 10.222.0.18 "GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e" status: 404 len: 111 microversion: 2.1 time: 0.039680 Aug 24 17:43:27.522227 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: [pid: 121010|app: 0|req: 741/1501] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Aug 24 17:43:27 2022] GET /compute/v2.1/servers/137b2582-da44-46ab-bada-51ce26ff3f6e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:45:56.471623 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:45:56.472338 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Wed Aug 24 17:45:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:46:00.987727 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:46:00.988334 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Wed Aug 24 17:46:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:46:01.253143 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:46:01.253696 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Wed Aug 24 17:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:46:20.119114 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:46:20.119781 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Wed Aug 24 17:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:46:20.618837 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:46:20.619447 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Wed Aug 24 17:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:47:44.788393 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:47:44.789057 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Wed Aug 24 17:47:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:49:16.480155 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:49:16.480824 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Wed Aug 24 17:49:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:49:20.996507 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:49:20.997133 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Wed Aug 24 17:49:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:49:21.262360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:49:21.262360 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Wed Aug 24 17:49:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:49:40.127261 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:49:40.127806 dv-cinder-851640-4-iscsi devstack@n-api.service[121011]: Wed Aug 24 17:49:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:49:40.626822 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:49:40.627411 dv-cinder-851640-4-iscsi devstack@n-api.service[121010]: Wed Aug 24 17:49:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!